2023-07-22T15:09:05.733 INFO:root:teuthology version: 0.0.1.dev158+g1426592 2023-07-22T15:09:05.734 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --verbose --archive /home/teuthworker/archive/yuriw-2023-07-22_15:03:05-rbd-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7348020 --description rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} --name yuriw-2023-07-22_15:03:05-rbd-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-07-22_15:03:05-rbd-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7348020/orig.config.yaml 2023-07-22T15:09:05.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-22T15:09:05.860 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-07-22_15:03:05-rbd-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7348020 branch: wip-yuri10-testing-2023-07-21-0828-reef description: rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration} email: null first_in_suite: false job_id: '7348020' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-07-22_15:03:05-rbd-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-yuri10-testing-2023-07-21-0828-reef ceph: conf: client: rbd default features: 1 global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: 1bf364b918a7ab4708130a64bf96639942959f6d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: osd default pool size: 2 install: ceph: flavor: default sha1: 1bf364b918a7ab4708130a64bf96639942959f6d selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri10-testing-2023-07-21-0828-reef sha1: 1bf364b918a7ab4708130a64bf96639942959f6d owner: scheduled_yuriw@teuthology priority: 95 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 9766 sha1: 1bf364b918a7ab4708130a64bf96639942959f6d sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri10-testing-2023-07-21-0828-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1bf364b918a7ab4708130a64bf96639942959f6d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1bf364b918a7ab4708130a64bf96639942959f6d targets: smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_migration.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1426592083662fef3e03bbeec33624331f0fdbc1 timestamp: 2023-07-22_15:03:05 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-22T15:09:05.861 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1bf364b918a7ab4708130a64bf96639942959f6d/qa; will attempt to use it 2023-07-22T15:09:05.922 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1bf364b918a7ab4708130a64bf96639942959f6d/qa/tasks 2023-07-22T15:09:05.922 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-22T15:09:05.925 INFO:teuthology.task.internal:Checking packages... 2023-07-22T15:09:05.965 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '1bf364b918a7ab4708130a64bf96639942959f6d' 2023-07-22T15:09:05.965 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-22T15:09:05.966 INFO:teuthology.packaging:ref: None 2023-07-22T15:09:05.966 INFO:teuthology.packaging:tag: None 2023-07-22T15:09:05.966 INFO:teuthology.packaging:branch: wip-yuri10-testing-2023-07-21-0828-reef 2023-07-22T15:09:05.966 INFO:teuthology.packaging:sha1: 1bf364b918a7ab4708130a64bf96639942959f6d 2023-07-22T15:09:05.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2023-07-21-0828-reef 2023-07-22T15:09:06.354 INFO:teuthology.task.internal:Found packages for ceph version 18.1.2-167.g1bf364b9 2023-07-22T15:09:06.354 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-22T15:09:06.362 INFO:teuthology.task.internal:no buildpackages task found 2023-07-22T15:09:06.362 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-22T15:09:06.371 INFO:teuthology.task.internal:Saving configuration 2023-07-22T15:09:06.384 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-22T15:09:06.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-22T15:09:06.419 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-22_15:03:05-rbd-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7348020', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-22 15:04:36.954187', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-22T15:09:06.420 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-22T15:09:06.427 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-07-22T15:09:06.428 INFO:teuthology.run_tasks:Running task console_log... 2023-07-22T15:09:06.474 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7a72b73d30>, signals=[15]) 2023-07-22T15:09:06.475 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-22T15:09:06.484 INFO:teuthology.task.internal:Opening connections... 2023-07-22T15:09:06.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-07-22T15:09:06.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T15:09:06.558 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-22T15:09:06.566 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-07-22T15:09:06.587 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-07-22T15:09:06.587 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-07-22T15:09:06.646 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Red Hat Enterprise Linux" 2023-07-22T15:09:06.647 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="8.6 (Ootpa)" 2023-07-22T15:09:06.647 INFO:teuthology.orchestra.run.smithi037.stdout:ID="rhel" 2023-07-22T15:09:06.647 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="fedora" 2023-07-22T15:09:06.648 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="8.6" 2023-07-22T15:09:06.648 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el8" 2023-07-22T15:09:06.648 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-22T15:09:06.649 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-07-22T15:09:06.649 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-22T15:09:06.649 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.redhat.com/" 2023-07-22T15:09:06.650 INFO:teuthology.orchestra.run.smithi037.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-22T15:09:06.650 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-22T15:09:06.650 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:09:06.651 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-22T15:09:06.651 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-22T15:09:06.651 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-22T15:09:06.651 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-22T15:09:06.652 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-07-22T15:09:06.673 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-22T15:09:06.682 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-22T15:09:06.690 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-22T15:09:06.691 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-07-22T15:09:06.708 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-22T15:09:06.715 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-22T15:09:06.716 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-07-22T15:09:06.771 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-22T15:09:06.810 INFO:teuthology.run_tasks:Running task kernel... 2023-07-22T15:09:06.829 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-07-22T15:09:06.830 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-07-22T15:09:06.830 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-22T15:09:06.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-22T15:09:06.848 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-07-22T15:09:06.908 INFO:teuthology.orchestra.run.smithi037.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-22T15:09:06.908 INFO:teuthology.task.kernel:Running kernel on smithi037: 4.18.0-372.9.1.el8.x86_64 2023-07-22T15:09:06.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2023-07-22T15:09:08.304 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:09:08.304 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-07-22T15:09:10.019 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 7.3 kB/s | 3.5 kB 00:00 2023-07-22T15:09:12.044 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 7.8 MB/s | 16 MB 00:02 2023-07-22T15:09:15.677 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 341 kB/s | 24 kB 00:00 2023-07-22T15:09:16.397 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-07-22T15:09:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:09:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:09:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:09:16.572 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2023-07-22T15:09:16.925 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:09:16.926 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-07-22T15:09:17.192 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:02 ago on Sat 22 Jul 2023 03:09:15 PM UTC. 2023-07-22T15:09:17.237 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-22T15:09:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:Error: No packages marked for reinstall. 2023-07-22T15:09:17.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2023-07-22T15:09:17.667 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:09:17.667 INFO:teuthology.orchestra.run.smithi037.stdout:Unable to read consumer identity 2023-07-22T15:09:17.933 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:02 ago on Sat 22 Jul 2023 03:09:15 PM UTC. 2023-07-22T15:09:17.977 INFO:teuthology.orchestra.run.smithi037.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-07-22T15:09:18.006 INFO:teuthology.orchestra.run.smithi037.stderr:Error: No packages marked for reinstall. 2023-07-22T15:09:18.053 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2023-07-22T15:09:18.136 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-07-22T15:09:18.137 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-07-22T15:09:18.137 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-07-22T15:09:18.137 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-22T15:09:18.137 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-22T15:09:18.173 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2023-07-22T15:09:18.189 DEBUG:teuthology.parallel:result is None 2023-07-22T15:09:18.190 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-22T15:09:18.200 INFO:teuthology.task.internal:Creating test directory... 2023-07-22T15:09:18.200 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-22T15:09:18.246 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-22T15:09:18.258 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-22T15:09:18.266 INFO:teuthology.task.internal:Creating archive directory... 2023-07-22T15:09:18.266 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-22T15:09:18.307 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-22T15:09:18.315 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-22T15:09:18.316 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-22T15:09:18.397 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-22T15:09:18.407 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-22T15:09:18.408 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-22T15:09:18.417 INFO:teuthology.task.internal:Configuring sudo... 2023-07-22T15:09:18.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-22T15:09:18.445 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-22T15:09:18.454 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-22T15:09:18.455 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-22T15:09:18.501 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-22T15:09:18.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-22T15:09:18.643 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-22T15:09:18.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-22T15:09:18.767 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:09:18.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-22T15:09:18.844 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-07-22T15:09:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-22T15:09:19.372 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-22T15:09:19.407 INFO:teuthology.task.internal:Starting timer... 2023-07-22T15:09:19.407 INFO:teuthology.run_tasks:Running task pcp... 2023-07-22T15:09:19.453 INFO:teuthology.run_tasks:Running task selinux... 2023-07-22T15:09:19.467 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-22T15:09:19.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-07-22T15:09:19.526 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2023-07-22T15:09:19.527 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-22T15:09:19.528 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-07-22T15:09:19.552 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-07-22T15:09:19.552 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive'} 2023-07-22T15:09:19.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-22T15:09:19.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-22T15:09:19.619 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-22T15:09:19.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-07-22T15:09:19.705 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-22T15:09:19.713 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-07-22T15:09:19.714 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-22T15:09:19.734 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-22T15:09:19.736 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-22T15:17:53.396 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com')] 2023-07-22T15:17:53.397 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-22T15:17:53.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-22T15:17:53.471 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-07-22T15:17:53.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-22T15:17:53.559 INFO:teuthology.run_tasks:Running task clock... 2023-07-22T15:17:53.582 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-22T15:17:53.583 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-22T15:17:53.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-22T15:17:53.636 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-22T15:17:53.655 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-22T15:17:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-07-22T15:17:53.731 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-07-22T15:17:53.745 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-22T15:17:53.758 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-22T15:17:53.837 INFO:teuthology.orchestra.run.smithi037.stderr:bash: ntpq: command not found 2023-07-22T15:17:53.838 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-22T15:17:53.838 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-07-22T15:17:53.838 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-22T15:17:53.838 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-22T15:17:53.838 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-22T15:17:53.839 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-22T15:17:53.839 INFO:teuthology.run_tasks:Running task install... 2023-07-22T15:17:53.852 DEBUG:teuthology.task.install:project ceph 2023-07-22T15:17:53.852 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1bf364b918a7ab4708130a64bf96639942959f6d'}} 2023-07-22T15:17:53.853 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '1bf364b918a7ab4708130a64bf96639942959f6d'} 2023-07-22T15:17:53.853 INFO:teuthology.task.install:Using flavor: default 2023-07-22T15:17:53.892 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-22T15:17:53.893 INFO:teuthology.task.install:extra packages: [] 2023-07-22T15:17:53.893 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1bf364b918a7ab4708130a64bf96639942959f6d', 'tag': None, 'wait_for_package': False} 2023-07-22T15:17:53.894 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1bf364b918a7ab4708130a64bf96639942959f6d 2023-07-22T15:17:54.126 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-21-0828-reef/1bf364b918a7ab4708130a64bf96639942959f6d/centos/8/flavors/default/ 2023-07-22T15:17:54.127 INFO:teuthology.task.install.rpm:Package version is 18.1.2-167.g1bf364b9 2023-07-22T15:17:54.312 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-21-0828-reef/1bf364b918a7ab4708130a64bf96639942959f6d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-21-0828-reef/1bf364b918a7ab4708130a64bf96639942959f6d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri10-testing-2023-07-21-0828-reef/1bf364b918a7ab4708130a64bf96639942959f6d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-22T15:17:54.312 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:17:54.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-22T15:17:54.348 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-07-22T15:17:54.349 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1bf364b918a7ab4708130a64bf96639942959f6d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-22T15:17:54.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-22T15:17:54.502 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-22T15:17:54.570 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-07-22T15:17:54.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-07-22T15:17:54.965 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:17:55.246 INFO:teuthology.orchestra.run.smithi037.stdout:44 files removed 2023-07-22T15:17:55.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw 2023-07-22T15:17:55.647 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:17:56.530 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 152 kB/s | 80 kB 00:00 2023-07-22T15:17:56.999 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 22 kB/s | 9.4 kB 00:00 2023-07-22T15:17:57.399 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 4.0 kB/s | 1.5 kB 00:00 2023-07-22T15:17:57.574 INFO:teuthology.orchestra.run.smithi037.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-07-22T15:17:58.575 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-07-22T15:18:02.329 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 481 kB/s | 24 kB 00:00 2023-07-22T15:18:03.263 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 55 MB/s | 47 MB 00:00 2023-07-22T15:18:11.694 INFO:teuthology.orchestra.run.smithi037.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-07-22T15:18:23.765 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:18:23.767 INFO:teuthology.orchestra.run.smithi037.stdout:=================================================================================================== 2023-07-22T15:18:23.767 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:18:23.768 INFO:teuthology.orchestra.run.smithi037.stdout:=================================================================================================== 2023-07-22T15:18:23.768 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:18:23.768 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 13 M 2023-07-22T15:18:23.768 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-07-22T15:18:23.769 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 3.7 M 2023-07-22T15:18:23.769 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 3.6 M 2023-07-22T15:18:23.769 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-22T15:18:23.770 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 5.4 M 2023-07-22T15:18:23.770 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 22 M 2023-07-22T15:18:23.770 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 24 k 2023-07-22T15:18:23.771 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-22T15:18:23.771 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 769 k 2023-07-22T15:18:23.771 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-22T15:18:23.771 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-22T15:18:23.772 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 474 k 2023-07-22T15:18:23.772 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-22T15:18:23.772 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 6.5 M 2023-07-22T15:18:23.772 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-22T15:18:23.773 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-22T15:18:23.774 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 45 k 2023-07-22T15:18:23.774 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 119 k 2023-07-22T15:18:23.774 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 190 k 2023-07-22T15:18:23.775 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-22T15:18:23.775 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 371 k 2023-07-22T15:18:23.775 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 364 k 2023-07-22T15:18:23.776 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 107 k 2023-07-22T15:18:23.776 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-22T15:18:23.776 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:18:23.776 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:18:23.777 INFO:teuthology.orchestra.run.smithi037.stdout:=================================================================================================== 2023-07-22T15:18:23.778 INFO:teuthology.orchestra.run.smithi037.stdout:Install 21 Packages 2023-07-22T15:18:23.778 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2023-07-22T15:18:23.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:18:23.779 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 59 M 2023-07-22T15:18:23.779 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:18:24.626 INFO:teuthology.orchestra.run.smithi037.stdout:(1/23): ceph-base-18.1.2-167.g1bf364b9.el8.x86_ 6.5 MB/s | 5.4 MB 00:00 2023-07-22T15:18:24.713 INFO:teuthology.orchestra.run.smithi037.stdout:(2/23): ceph-selinux-18.1.2-167.g1bf364b9.el8.x 283 kB/s | 24 kB 00:00 2023-07-22T15:18:24.879 INFO:teuthology.orchestra.run.smithi037.stdout:(3/23): libcephfs2-18.1.2-167.g1bf364b9.el8.x86 4.5 MB/s | 769 kB 00:00 2023-07-22T15:18:25.249 INFO:teuthology.orchestra.run.smithi037.stdout:(4/23): libradosstriper1-18.1.2-167.g1bf364b9.e 1.3 MB/s | 474 kB 00:00 2023-07-22T15:18:25.633 INFO:teuthology.orchestra.run.smithi037.stdout:(5/23): ceph-common-18.1.2-167.g1bf364b9.el8.x8 12 MB/s | 22 MB 00:01 2023-07-22T15:18:26.056 INFO:teuthology.orchestra.run.smithi037.stdout:(6/23): python3-ceph-argparse-18.1.2-167.g1bf36 105 kB/s | 45 kB 00:00 2023-07-22T15:18:26.173 INFO:teuthology.orchestra.run.smithi037.stdout:(7/23): librgw2-18.1.2-167.g1bf364b9.el8.x86_64 7.0 MB/s | 6.5 MB 00:00 2023-07-22T15:18:26.197 INFO:teuthology.orchestra.run.smithi037.stdout:(8/23): python3-ceph-common-18.1.2-167.g1bf364b 835 kB/s | 119 kB 00:00 2023-07-22T15:18:26.250 INFO:teuthology.orchestra.run.smithi037.stdout:(9/23): python3-cephfs-18.1.2-167.g1bf364b9.el8 2.5 MB/s | 190 kB 00:00 2023-07-22T15:18:26.292 INFO:teuthology.orchestra.run.smithi037.stdout:(10/23): python3-rados-18.1.2-167.g1bf364b9.el8 3.9 MB/s | 371 kB 00:00 2023-07-22T15:18:26.424 INFO:teuthology.orchestra.run.smithi037.stdout:(11/23): ceph-radosgw-18.1.2-167.g1bf364b9.el8. 5.0 MB/s | 13 MB 00:02 2023-07-22T15:18:26.448 INFO:teuthology.orchestra.run.smithi037.stdout:(12/23): python3-rgw-18.1.2-167.g1bf364b9.el8.x 673 kB/s | 107 kB 00:00 2023-07-22T15:18:26.477 INFO:teuthology.orchestra.run.smithi037.stdout:(13/23): python3-rbd-18.1.2-167.g1bf364b9.el8.x 1.6 MB/s | 364 kB 00:00 2023-07-22T15:18:26.621 INFO:teuthology.orchestra.run.smithi037.stdout:(14/23): libunwind-1.3.1-3.el8.x86_64.rpm 530 kB/s | 75 kB 00:00 2023-07-22T15:18:26.642 INFO:teuthology.orchestra.run.smithi037.stdout:(15/23): liboath-2.6.2-3.el8.x86_64.rpm 306 kB/s | 59 kB 00:00 2023-07-22T15:18:26.666 INFO:teuthology.orchestra.run.smithi037.stdout:(16/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2023-07-22T15:18:26.750 INFO:teuthology.orchestra.run.smithi037.stdout:(17/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.3 MB/s | 259 kB 00:00 2023-07-22T15:18:26.786 INFO:teuthology.orchestra.run.smithi037.stdout:(18/23): python3-prettytable-0.7.2-14.el8.noarc 376 kB/s | 44 kB 00:00 2023-07-22T15:18:26.832 INFO:teuthology.orchestra.run.smithi037.stdout:(19/23): thrift-0.13.0-2.el8.x86_64.rpm 8.3 MB/s | 1.7 MB 00:00 2023-07-22T15:18:26.850 INFO:teuthology.orchestra.run.smithi037.stdout:(20/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 699 kB/s | 47 kB 00:00 2023-07-22T15:18:26.876 INFO:teuthology.orchestra.run.smithi037.stdout:(21/23): librdkafka-0.11.4-3.el8.x86_64.rpm 2.7 MB/s | 354 kB 00:00 2023-07-22T15:18:27.187 INFO:teuthology.orchestra.run.smithi037.stdout:(22/23): librados2-18.1.2-167.g1bf364b9.el8.x86 10 MB/s | 3.7 MB 00:00 2023-07-22T15:18:27.510 INFO:teuthology.orchestra.run.smithi037.stdout:(23/23): librbd1-18.1.2-167.g1bf364b9.el8.x86_6 5.4 MB/s | 3.6 MB 00:00 2023-07-22T15:18:27.514 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:18:27.514 INFO:teuthology.orchestra.run.smithi037.stdout:Total 16 MB/s | 59 MB 00:03 2023-07-22T15:18:27.564 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:18:27.610 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:18:27.610 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:18:27.960 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:18:27.965 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:18:29.303 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:18:29.567 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/25 2023-07-22T15:18:29.778 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-07-22T15:18:30.205 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-07-22T15:18:30.449 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:18.1.2-167.g1bf364b9.el8.x86_64 3/25 2023-07-22T15:18:30.548 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:18.1.2-167.g1bf364b9.el8.x86_64 3/25 2023-07-22T15:18:30.731 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:18.1.2-167.g1bf364b9.el8.x86_64 4/25 2023-07-22T15:18:31.012 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/25 2023-07-22T15:18:31.213 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:18.1.2-167.g1bf364b9.el8.x86_64 6/25 2023-07-22T15:18:31.656 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:18.1.2-167.g1bf364b9.el8.x86_64 6/25 2023-07-22T15:18:31.833 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:18.1.2-167.g1bf364b9.el8.x86_64 7/25 2023-07-22T15:18:31.908 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:18.1.2-167.g1bf364b9.el8.x86_64 7/25 2023-07-22T15:18:32.133 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/25 2023-07-22T15:18:32.316 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/25 2023-07-22T15:18:32.389 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/25 2023-07-22T15:18:32.537 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:18.1.2-167.g1bf364b9.el8.x 10/25 2023-07-22T15:18:32.733 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:18.1.2-167.g1bf364b9.el8.x86_64 11/25 2023-07-22T15:18:32.971 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:18.1.2-167.g1bf364b9.el8.x86_64 12/25 2023-07-22T15:18:33.145 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:18.1.2-167.g1bf364b9.el8.x86_64 13/25 2023-07-22T15:18:33.243 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:18.1.2-167.g1bf364b9.el8.x86_64 13/25 2023-07-22T15:18:33.405 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 14/25 2023-07-22T15:18:33.864 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 15/25 2023-07-22T15:18:34.688 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 16/25 2023-07-22T15:18:34.883 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:18.1.2-167.g1bf364b9.el8.x86_64 17/25 2023-07-22T15:18:34.949 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:18.1.2-167.g1bf364b9.el8.x86_64 17/25 2023-07-22T15:18:35.220 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:18.1.2-167.g1bf364b9.el8.x86_64 18/25 2023-07-22T15:18:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:18.1.2-167.g1bf364b9.el8.x86 19/25 2023-07-22T15:18:39.181 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.1.2-167.g1bf364b9.el8.x86_64 20/25 2023-07-22T15:18:39.583 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:18.1.2-167.g1bf364b9.el8.x86_64 20/25 2023-07-22T15:18:40.236 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:18.1.2-167.g1bf364b9.el8.x86_64 20/25 2023-07-22T15:18:40.539 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:18.1.2-167.g1bf364b9.el8.x86_64 21/25 2023-07-22T15:18:40.616 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:18.1.2-167.g1bf364b9.el8.x86_64 21/25 2023-07-22T15:18:40.775 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:18.1.2-167.g1bf364b9.el8.x86_64 22/25 2023-07-22T15:19:00.192 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:18.1.2-167.g1bf364b9.el8.x86_64 22/25 2023-07-22T15:19:00.193 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-07-22T15:19:00.193 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-07-22T15:19:00.193 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-07-22T15:19:00.193 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /run 2023-07-22T15:19:00.193 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-07-22T15:19:00.193 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-07-22T15:19:00.194 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-07-22T15:19:00.194 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-07-22T15:19:00.194 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /dev 2023-07-22T15:19:00.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:01.628 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:18.1.2-167.g1bf364b9.el8.x86_64 23/25 2023-07-22T15:19:01.649 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:18.1.2-167.g1bf364b9.el8.x86_64 23/25 2023-07-22T15:19:01.650 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-07-22T15:19:01.849 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-07-22T15:19:01.849 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-07-22T15:19:02.462 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-07-22T15:19:02.462 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:18.1.2-167.g1bf364b9.el8.x86_64 1/25 2023-07-22T15:19:02.462 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:18.1.2-167.g1bf364b9.el8.x86_64 2/25 2023-07-22T15:19:02.462 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:18.1.2-167.g1bf364b9.el8.x86_64 3/25 2023-07-22T15:19:02.462 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:18.1.2-167.g1bf364b9.el8.x86_64 4/25 2023-07-22T15:19:02.462 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:18.1.2-167.g1bf364b9.el8.x86_64 5/25 2023-07-22T15:19:02.463 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:18.1.2-167.g1bf364b9.el8.x86_64 6/25 2023-07-22T15:19:02.463 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:18.1.2-167.g1bf364b9.el8.x86_64 7/25 2023-07-22T15:19:02.463 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:18.1.2-167.g1bf364b9.el8.x 8/25 2023-07-22T15:19:02.463 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:18.1.2-167.g1bf364b9.el8.x86 9/25 2023-07-22T15:19:02.463 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:18.1.2-167.g1bf364b9.el8.x86_64 10/25 2023-07-22T15:19:02.463 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:18.1.2-167.g1bf364b9.el8.x86_64 11/25 2023-07-22T15:19:02.463 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:18.1.2-167.g1bf364b9.el8.x86_64 12/25 2023-07-22T15:19:02.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:18.1.2-167.g1bf364b9.el8.x86_64 13/25 2023-07-22T15:19:02.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 14/25 2023-07-22T15:19:02.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 15/25 2023-07-22T15:19:02.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 16/25 2023-07-22T15:19:02.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 17/25 2023-07-22T15:19:02.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 18/25 2023-07-22T15:19:02.464 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/25 2023-07-22T15:19:02.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 20/25 2023-07-22T15:19:02.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 21/25 2023-07-22T15:19:02.468 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:18.1.2-167.g1bf364b9.el8.x86_64 22/25 2023-07-22T15:19:02.468 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-07-22T15:19:02.469 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:18.1.2-167.g1bf364b9.el8.x86_64 24/25 2023-07-22T15:19:03.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-07-22T15:19:03.898 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:52 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:19:07.626 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:19:07.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:07.842 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-07-22T15:19:07.843 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.843 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.844 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:19:07.845 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.845 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.845 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.845 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.846 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-22T15:19:07.847 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.847 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-22T15:19:07.847 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-22T15:19:07.848 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.848 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-22T15:19:07.848 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.849 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-22T15:19:07.849 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-22T15:19:07.849 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.849 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.853 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.854 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-22T15:19:07.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.855 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:07.856 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-22T15:19:07.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:07.872 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:19:08.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-test 2023-07-22T15:19:08.403 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:19:09.292 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:58 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:19:10.829 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:19:10.829 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-07-22T15:19:10.829 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:19:10.830 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-07-22T15:19:10.830 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:19:10.830 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 47 M 2023-07-22T15:19:10.830 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-22T15:19:10.831 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-22T15:19:10.831 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 137 k 2023-07-22T15:19:10.831 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-22T15:19:10.832 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-22T15:19:10.832 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-22T15:19:10.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:10.833 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:19:10.833 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-07-22T15:19:10.833 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2023-07-22T15:19:10.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:10.835 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 48 M 2023-07-22T15:19:10.835 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 211 M 2023-07-22T15:19:10.835 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:19:10.880 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-07-22T15:19:11.105 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): socat-1.7.4.1-1.el8.x86_64.rpm 1.5 MB/s | 323 kB 00:00 2023-07-22T15:19:11.161 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-07-22T15:19:11.237 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): jq-1.6-3.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-07-22T15:19:11.302 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): libcephsqlite-18.1.2-167.g1bf364b9.el8.x 293 kB/s | 137 kB 00:00 2023-07-22T15:19:14.698 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): ceph-test-18.1.2-167.g1bf364b9.el8.x86_6 12 MB/s | 47 MB 00:03 2023-07-22T15:19:14.699 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:19:14.699 INFO:teuthology.orchestra.run.smithi037.stdout:Total 12 MB/s | 48 MB 00:03 2023-07-22T15:19:14.737 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:19:14.765 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:19:14.771 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:19:15.030 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:19:15.030 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:19:15.479 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:19:15.621 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 1/6 2023-07-22T15:19:15.714 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 1/6 2023-07-22T15:19:15.934 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-3.el8.x86_64 2/6 2023-07-22T15:19:16.086 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/6 2023-07-22T15:19:16.293 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 4/6 2023-07-22T15:19:16.462 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:18.1.2-167.g1bf364b9.el8.x86_64 5/6 2023-07-22T15:19:21.247 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:18.1.2-167.g1bf364b9.el8.x86_64 5/6 2023-07-22T15:19:21.526 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:18.1.2-167.g1bf364b9.el8.x86_64 6/6 2023-07-22T15:19:21.756 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-test-2:18.1.2-167.g1bf364b9.el8.x86_64 6/6 2023-07-22T15:19:21.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:18.1.2-167.g1bf364b9.el8.x86_64 1/6 2023-07-22T15:19:21.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:18.1.2-167.g1bf364b9.el8.x86_64 2/6 2023-07-22T15:19:21.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 3/6 2023-07-22T15:19:21.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/6 2023-07-22T15:19:21.757 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2023-07-22T15:19:22.855 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-3.el8.x86_64 6/6 2023-07-22T15:19:22.857 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:11 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:19:26.088 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:19:26.298 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:26.298 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:19:26.298 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:26.298 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-3.el8.x86_64 2023-07-22T15:19:26.298 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:26.299 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-22T15:19:26.299 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-22T15:19:26.299 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-22T15:19:26.299 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:26.299 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:19:26.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph 2023-07-22T15:19:26.810 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:19:27.722 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:16 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:19:29.271 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:19:29.275 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================== 2023-07-22T15:19:29.276 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:19:29.276 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================== 2023-07-22T15:19:29.276 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:19:29.276 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 6.4 k 2023-07-22T15:19:29.276 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-22T15:19:29.276 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 2.3 M 2023-07-22T15:19:29.277 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 1.5 M 2023-07-22T15:19:29.277 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 240 k 2023-07-22T15:19:29.277 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 4.6 M 2023-07-22T15:19:29.277 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 18 M 2023-07-22T15:19:29.277 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-22T15:19:29.277 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-22T15:19:29.277 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-22T15:19:29.278 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-22T15:19:29.278 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-22T15:19:29.278 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-22T15:19:29.278 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-22T15:19:29.278 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-22T15:19:29.278 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-22T15:19:29.279 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-22T15:19:29.279 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-22T15:19:29.279 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-22T15:19:29.279 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-22T15:19:29.279 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-22T15:19:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-22T15:19:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-22T15:19:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-22T15:19:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-22T15:19:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-22T15:19:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-22T15:19:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-22T15:19:29.280 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-22T15:19:29.281 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-22T15:19:29.281 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-22T15:19:29.281 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-22T15:19:29.281 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-22T15:19:29.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:29.282 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:19:29.283 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================================== 2023-07-22T15:19:29.283 INFO:teuthology.orchestra.run.smithi037.stdout:Install 32 Packages 2023-07-22T15:19:29.283 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:29.284 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 30 M 2023-07-22T15:19:29.284 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 119 M 2023-07-22T15:19:29.284 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:19:30.056 INFO:teuthology.orchestra.run.smithi037.stdout:(1/32): ceph-18.1.2-167.g1bf364b9.el8.x86_64.rp 19 kB/s | 6.4 kB 00:00 2023-07-22T15:19:31.414 INFO:teuthology.orchestra.run.smithi037.stdout:(2/32): ceph-mgr-18.1.2-167.g1bf364b9.el8.x86_6 939 kB/s | 1.5 MB 00:01 2023-07-22T15:19:31.849 INFO:teuthology.orchestra.run.smithi037.stdout:(3/32): ceph-mds-18.1.2-167.g1bf364b9.el8.x86_6 1.1 MB/s | 2.3 MB 00:02 2023-07-22T15:19:31.998 INFO:teuthology.orchestra.run.smithi037.stdout:(4/32): ceph-mgr-modules-core-18.1.2-167.g1bf36 1.6 MB/s | 240 kB 00:00 2023-07-22T15:19:32.191 INFO:teuthology.orchestra.run.smithi037.stdout:(5/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 228 kB/s | 44 kB 00:00 2023-07-22T15:19:32.348 INFO:teuthology.orchestra.run.smithi037.stdout:(6/32): python3-beautifulsoup4-4.6.3-2.el8.1.no 1.1 MB/s | 185 kB 00:00 2023-07-22T15:19:32.426 INFO:teuthology.orchestra.run.smithi037.stdout:(7/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.2 MB/s | 173 kB 00:00 2023-07-22T15:19:32.545 INFO:teuthology.orchestra.run.smithi037.stdout:(8/32): python3-cherrypy-18.4.0-1.el8.noarch.rp 3.2 MB/s | 384 kB 00:00 2023-07-22T15:19:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:(9/32): ceph-mon-18.1.2-167.g1bf364b9.el8.x86_6 1.8 MB/s | 4.6 MB 00:02 2023-07-22T15:19:32.662 INFO:teuthology.orchestra.run.smithi037.stdout:(10/32): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-07-22T15:19:32.702 INFO:teuthology.orchestra.run.smithi037.stdout:(11/32): python3-jaraco-functools-2.0-4.el8.noa 263 kB/s | 18 kB 00:00 2023-07-22T15:19:32.792 INFO:teuthology.orchestra.run.smithi037.stdout:(12/32): python3-more-itertools-7.2.0-3.el8.noa 641 kB/s | 59 kB 00:00 2023-07-22T15:19:32.852 INFO:teuthology.orchestra.run.smithi037.stdout:(13/32): python3-logutils-0.3.5-11.el8.noarch.r 254 kB/s | 49 kB 00:00 2023-07-22T15:19:32.876 INFO:teuthology.orchestra.run.smithi037.stdout:(14/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-07-22T15:19:32.929 INFO:teuthology.orchestra.run.smithi037.stdout:(15/32): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-07-22T15:19:32.956 INFO:teuthology.orchestra.run.smithi037.stdout:(16/32): python3-simplegeneric-0.8.1-17.el8.noa 249 kB/s | 19 kB 00:00 2023-07-22T15:19:33.003 INFO:teuthology.orchestra.run.smithi037.stdout:(17/32): python3-singledispatch-3.4.0.3-18.el8. 318 kB/s | 24 kB 00:00 2023-07-22T15:19:33.027 INFO:teuthology.orchestra.run.smithi037.stdout:(18/32): python3-tempora-1.14.1-5.el8.noarch.rp 388 kB/s | 29 kB 00:00 2023-07-22T15:19:33.080 INFO:teuthology.orchestra.run.smithi037.stdout:(19/32): python3-trustme-0.6.0-4.el8.noarch.rpm 364 kB/s | 27 kB 00:00 2023-07-22T15:19:33.104 INFO:teuthology.orchestra.run.smithi037.stdout:(20/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2023-07-22T15:19:33.172 INFO:teuthology.orchestra.run.smithi037.stdout:(21/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.2 MB/s | 85 kB 00:00 2023-07-22T15:19:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:(22/32): python3-zc-lockfile-2.0-2.el8.noarch.r 250 kB/s | 23 kB 00:00 2023-07-22T15:19:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:(23/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.2 MB/s | 251 kB 00:00 2023-07-22T15:19:33.354 INFO:teuthology.orchestra.run.smithi037.stdout:(24/32): python3-pytz-2017.2-9.el8.noarch.rpm 590 kB/s | 54 kB 00:00 2023-07-22T15:19:33.372 INFO:teuthology.orchestra.run.smithi037.stdout:(25/32): python3-markupsafe-0.23-19.el8.x86_64. 464 kB/s | 39 kB 00:00 2023-07-22T15:19:33.407 INFO:teuthology.orchestra.run.smithi037.stdout:(26/32): python3-mako-1.0.6-13.el8.noarch.rpm 3.0 MB/s | 157 kB 00:00 2023-07-22T15:19:33.439 INFO:teuthology.orchestra.run.smithi037.stdout:(27/32): python3-werkzeug-0.12.2-4.el8.noarch.r 6.7 MB/s | 457 kB 00:00 2023-07-22T15:19:33.464 INFO:teuthology.orchestra.run.smithi037.stdout:(28/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 1.7 MB/s | 103 kB 00:00 2023-07-22T15:19:33.490 INFO:teuthology.orchestra.run.smithi037.stdout:(29/32): python3-pycparser-2.14-14.el8.noarch.r 2.1 MB/s | 109 kB 00:00 2023-07-22T15:19:33.522 INFO:teuthology.orchestra.run.smithi037.stdout:(30/32): python3-cryptography-3.2.1-5.el8.x86_6 9.3 MB/s | 559 kB 00:00 2023-07-22T15:19:33.549 INFO:teuthology.orchestra.run.smithi037.stdout:(31/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-07-22T15:19:34.161 INFO:teuthology.orchestra.run.smithi037.stdout:(32/32): ceph-osd-18.1.2-167.g1bf364b9.el8.x86_ 6.5 MB/s | 18 MB 00:02 2023-07-22T15:19:34.161 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:19:34.161 INFO:teuthology.orchestra.run.smithi037.stdout:Total 6.1 MB/s | 30 MB 00:04 2023-07-22T15:19:34.249 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:19:34.290 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:19:34.290 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:19:34.516 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:19:34.516 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:19:36.163 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:19:36.409 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-07-22T15:19:36.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-07-22T15:19:36.879 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 3/32 2023-07-22T15:19:37.260 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 4/32 2023-07-22T15:19:37.520 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 5/32 2023-07-22T15:19:37.708 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 6/32 2023-07-22T15:19:37.908 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 7/32 2023-07-22T15:19:38.245 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 8/32 2023-07-22T15:19:38.438 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 9/32 2023-07-22T15:19:38.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 10/32 2023-07-22T15:19:38.905 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 11/32 2023-07-22T15:19:39.092 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 12/32 2023-07-22T15:19:39.310 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 13/32 2023-07-22T15:19:39.471 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 14/32 2023-07-22T15:19:39.662 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 15/32 2023-07-22T15:19:39.821 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 16/32 2023-07-22T15:19:39.979 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 17/32 2023-07-22T15:19:40.147 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 18/32 2023-07-22T15:19:40.390 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 19/32 2023-07-22T15:19:40.620 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 20/32 2023-07-22T15:19:40.805 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-07-22T15:19:41.086 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-07-22T15:19:41.316 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-07-22T15:19:41.527 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/32 2023-07-22T15:19:41.851 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 25/32 2023-07-22T15:19:42.196 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-07-22T15:19:42.517 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:18.1.2-167.g1bf364b9.el8.n 27/32 2023-07-22T15:19:42.681 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:18.1.2-167.g1bf364b9.el8.x86_64 28/32 2023-07-22T15:19:44.350 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:18.1.2-167.g1bf364b9.el8.x86_64 28/32 2023-07-22T15:19:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:18.1.2-167.g1bf364b9.el8.x86_64 29/32 2023-07-22T15:19:45.037 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:18.1.2-167.g1bf364b9.el8.x86_64 29/32 2023-07-22T15:19:45.188 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:18.1.2-167.g1bf364b9.el8.x86_64 30/32 2023-07-22T15:19:45.416 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:18.1.2-167.g1bf364b9.el8.x86_64 30/32 2023-07-22T15:19:45.573 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:18.1.2-167.g1bf364b9.el8.x86_64 31/32 2023-07-22T15:19:45.592 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:18.1.2-167.g1bf364b9.el8.x86_64 31/32 2023-07-22T15:19:45.760 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:18.1.2-167.g1bf364b9.el8.x86_64 32/32 2023-07-22T15:19:46.108 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-2:18.1.2-167.g1bf364b9.el8.x86_64 32/32 2023-07-22T15:19:46.109 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:18.1.2-167.g1bf364b9.el8.x86_64 1/32 2023-07-22T15:19:46.109 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:18.1.2-167.g1bf364b9.el8.x86_64 2/32 2023-07-22T15:19:46.109 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:18.1.2-167.g1bf364b9.el8.x86_64 3/32 2023-07-22T15:19:46.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:18.1.2-167.g1bf364b9.el8.x86_64 4/32 2023-07-22T15:19:46.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:18.1.2-167.g1bf364b9.el8.x86_64 5/32 2023-07-22T15:19:46.110 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:18.1.2-167.g1bf364b9.el8.n 6/32 2023-07-22T15:19:46.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/32 2023-07-22T15:19:46.111 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/32 2023-07-22T15:19:46.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/32 2023-07-22T15:19:46.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/32 2023-07-22T15:19:46.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 11/32 2023-07-22T15:19:46.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 12/32 2023-07-22T15:19:46.115 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 13/32 2023-07-22T15:19:46.116 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 14/32 2023-07-22T15:19:46.116 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 15/32 2023-07-22T15:19:46.116 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-2.6-1.el8.noarch 16/32 2023-07-22T15:19:46.117 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 17/32 2023-07-22T15:19:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 18/32 2023-07-22T15:19:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 19/32 2023-07-22T15:19:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 20/32 2023-07-22T15:19:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 21/32 2023-07-22T15:19:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 22/32 2023-07-22T15:19:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 23/32 2023-07-22T15:19:46.118 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 24/32 2023-07-22T15:19:46.119 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 25/32 2023-07-22T15:19:46.119 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 26/32 2023-07-22T15:19:46.119 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 27/32 2023-07-22T15:19:46.119 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 28/32 2023-07-22T15:19:46.119 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 29/32 2023-07-22T15:19:46.119 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 30/32 2023-07-22T15:19:46.119 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 31/32 2023-07-22T15:19:47.567 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 32/32 2023-07-22T15:19:47.567 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:36 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:19:51.204 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:19:51.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:51.409 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:19:51.409 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:51.409 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:51.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:51.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:19:51.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:51.410 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:19:51.410 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-22T15:19:51.410 INFO:teuthology.orchestra.run.smithi037.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-22T15:19:51.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-22T15:19:51.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-22T15:19:51.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-22T15:19:51.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-22T15:19:51.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-22T15:19:51.411 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-22T15:19:51.412 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-22T15:19:51.412 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-22T15:19:51.412 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-22T15:19:51.412 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-22T15:19:51.412 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-22T15:19:51.413 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-2.6-1.el8.noarch 2023-07-22T15:19:51.413 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-22T15:19:51.413 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-22T15:19:51.413 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-22T15:19:51.413 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-22T15:19:51.413 INFO:teuthology.orchestra.run.smithi037.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-22T15:19:51.413 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-22T15:19:51.414 INFO:teuthology.orchestra.run.smithi037.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-22T15:19:51.414 INFO:teuthology.orchestra.run.smithi037.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-22T15:19:51.414 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-22T15:19:51.414 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-22T15:19:51.414 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-22T15:19:51.414 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-22T15:19:51.414 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:51.415 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:19:52.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-base 2023-07-22T15:19:53.028 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:19:53.888 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:42 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:19:55.312 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-base-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:19:55.431 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:19:55.431 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:19:55.431 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:19:55.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install cephadm 2023-07-22T15:19:55.917 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:19:56.838 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:45 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:19:58.408 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:19:58.411 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:19:58.411 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:19:58.417 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:19:58.417 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:19:58.417 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 160 k 2023-07-22T15:19:58.417 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:58.417 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:19:58.417 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:19:58.417 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2023-07-22T15:19:58.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:19:58.418 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 160 k 2023-07-22T15:19:58.418 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 639 k 2023-07-22T15:19:58.418 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:19:58.723 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm-18.1.2-167.g1bf364b9.el8.noarch.rpm 513 kB/s | 160 kB 00:00 2023-07-22T15:19:58.723 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:19:58.724 INFO:teuthology.orchestra.run.smithi037.stdout:Total 511 kB/s | 160 kB 00:00 2023-07-22T15:19:58.724 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:19:58.746 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:19:58.747 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:19:58.748 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:19:58.748 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:19:58.779 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:20:00.543 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 1/1 2023-07-22T15:20:00.684 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 1/1 2023-07-22T15:20:00.859 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 1/1 2023-07-22T15:20:01.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 1/1 2023-07-22T15:20:01.899 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:50 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:20:05.114 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:20:05.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:20:05.312 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:20:05.312 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:20:05.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:20:05.313 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:20:05.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-immutable-object-cache 2023-07-22T15:20:05.854 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:20:06.730 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:55 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:20:08.247 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:20:08.248 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:20:08.248 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2023-07-22T15:20:08.248 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:20:08.248 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:20:08.248 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 165 k 2023-07-22T15:20:08.249 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:20:08.249 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:20:08.249 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:20:08.249 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2023-07-22T15:20:08.249 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:20:08.250 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 165 k 2023-07-22T15:20:08.250 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 503 k 2023-07-22T15:20:08.251 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:20:08.545 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-immutable-object-cache-18.1.2-167.g1bf364b 562 kB/s | 165 kB 00:00 2023-07-22T15:20:08.552 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:20:08.553 INFO:teuthology.orchestra.run.smithi037.stdout:Total 560 kB/s | 165 kB 00:00 2023-07-22T15:20:08.553 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:20:08.559 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:20:08.560 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:20:08.616 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:20:08.617 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:20:08.943 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:20:09.127 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:18.1.2-167.g1bf364b9.e 1/1 2023-07-22T15:20:09.488 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.1.2-167.g1bf364b9.e 1/1 2023-07-22T15:20:10.555 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:18.1.2-167.g1bf364b9.e 1/1 2023-07-22T15:20:10.556 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:59 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:20:15.388 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:20:15.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:20:15.590 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:20:15.590 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:20:15.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:20:15.590 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:20:15.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr 2023-07-22T15:20:16.160 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:20:17.044 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:06 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:20:18.470 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-mgr-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:20:18.591 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:20:18.591 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:20:18.591 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:20:18.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-dashboard 2023-07-22T15:20:19.076 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:20:20.026 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:02:09 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:20:21.579 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:20:21.579 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================== 2023-07-22T15:20:21.579 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:20:21.579 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================== 2023-07-22T15:20:21.580 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:20:21.580 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 1.7 M 2023-07-22T15:20:21.580 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-22T15:20:21.580 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 23 k 2023-07-22T15:20:21.580 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 15 k 2023-07-22T15:20:21.580 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-22T15:20:21.580 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-22T15:20:21.581 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-22T15:20:21.581 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:20:21.581 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:20:21.581 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================================== 2023-07-22T15:20:21.584 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2023-07-22T15:20:21.584 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:20:21.585 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.0 M 2023-07-22T15:20:21.585 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 8.0 M 2023-07-22T15:20:21.585 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:20:22.083 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): ceph-prometheus-alerts-18.1.2-167.g1bf36 31 kB/s | 15 kB 00:00 2023-07-22T15:20:22.110 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): ceph-grafana-dashboards-18.1.2-167.g1bf3 46 kB/s | 23 kB 00:00 2023-07-22T15:20:22.651 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): ceph-mgr-dashboard-18.1.2-167.g1bf364b9. 1.6 MB/s | 1.7 MB 00:01 2023-07-22T15:20:22.842 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 222 kB/s | 43 kB 00:00 2023-07-22T15:22:31.442 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] python3-repoze-lru-0.7-6.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-repoze-lru-0.7-6.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-22T15:22:31.443 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] python3-routes-2.4.1-12.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-routes-2.4.1-12.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-22T15:22:31.678 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 266 B/s | 34 kB 02:09 2023-07-22T15:22:31.836 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.5 kB/s | 196 kB 02:09 2023-07-22T15:22:31.838 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:22:31.838 INFO:teuthology.orchestra.run.smithi037.stdout:Total 16 kB/s | 2.0 MB 02:10 2023-07-22T15:22:31.850 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:22:31.866 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:22:31.866 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:22:31.926 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:22:31.932 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:22:32.186 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:22:32.379 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2023-07-22T15:22:32.562 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2023-07-22T15:22:32.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2023-07-22T15:22:32.959 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:18.1.2-167.g1bf364b9.el8.no 4/6 2023-07-22T15:22:33.304 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:18.1.2-167.g1bf364b9.el8.n 5/6 2023-07-22T15:22:33.524 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:18.1.2-167.g1bf364b9.el8.noarch 6/6 2023-07-22T15:22:33.769 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.1.2-167.g1bf364b9.el8.noarch 6/6 2023-07-22T15:22:33.769 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:18.1.2-167.g1bf364b9.el8.n 1/6 2023-07-22T15:22:33.770 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:18.1.2-167.g1bf364b9.el8.noarch 2/6 2023-07-22T15:22:33.770 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:18.1.2-167.g1bf364b9.el8.no 3/6 2023-07-22T15:22:33.770 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2023-07-22T15:22:33.770 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2023-07-22T15:22:34.822 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2023-07-22T15:22:34.823 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:04:23 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:22:42.508 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:22:42.706 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:22:42.706 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:22:42.707 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:22:42.707 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:22:42.707 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:22:42.707 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-22T15:22:42.707 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-22T15:22:42.707 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-22T15:22:42.707 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:22:42.707 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:22:42.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-diskprediction-local 2023-07-22T15:22:43.246 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:22:44.901 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:04:33 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:22:46.437 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:22:46.438 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================================= 2023-07-22T15:22:46.438 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:22:46.438 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================================= 2023-07-22T15:22:46.438 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:22:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 7.4 M 2023-07-22T15:22:46.439 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-22T15:22:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-22T15:22:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-22T15:22:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-22T15:22:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-22T15:22:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-22T15:22:46.439 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-22T15:22:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-22T15:22:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:22:46.440 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:22:46.440 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================================= 2023-07-22T15:22:46.440 INFO:teuthology.orchestra.run.smithi037.stdout:Install 8 Packages 2023-07-22T15:22:46.440 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:22:46.441 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 35 M 2023-07-22T15:22:46.441 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 210 M 2023-07-22T15:22:46.442 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:22:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:(1/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 8.6 MB/s | 3.7 MB 00:00 2023-07-22T15:22:47.059 INFO:teuthology.orchestra.run.smithi037.stdout:(2/8): python3-scipy-1.0.0-21.module+el8.5.0+10 22 MB/s | 14 MB 00:00 2023-07-22T15:22:47.084 INFO:teuthology.orchestra.run.smithi037.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.1 MB/s | 225 kB 00:00 2023-07-22T15:22:47.251 INFO:teuthology.orchestra.run.smithi037.stdout:(4/8): openblas-threads-0.3.15-3.el8.x86_64.rpm 25 MB/s | 4.9 MB 00:00 2023-07-22T15:22:47.376 INFO:teuthology.orchestra.run.smithi037.stdout:(5/8): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-07-22T15:22:47.485 INFO:teuthology.orchestra.run.smithi037.stdout:(6/8): ceph-mgr-diskprediction-local-18.1.2-167 7.1 MB/s | 7.4 MB 00:01 2023-07-22T15:22:47.510 INFO:teuthology.orchestra.run.smithi037.stdout:(7/8): libgfortran-8.5.0-10.1.el8_6.x86_64.rpm 2.4 MB/s | 644 kB 00:00 2023-07-22T15:22:47.552 INFO:teuthology.orchestra.run.smithi037.stdout:(8/8): libquadmath-8.5.0-10.1.el8_6.x86_64.rpm 977 kB/s | 171 kB 00:00 2023-07-22T15:22:47.553 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:22:47.553 INFO:teuthology.orchestra.run.smithi037.stdout:Total 32 MB/s | 35 MB 00:01 2023-07-22T15:22:47.799 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:22:47.818 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:22:47.819 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:22:48.130 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:22:48.134 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:22:48.729 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:22:48.883 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-07-22T15:22:49.031 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 1/8 2023-07-22T15:22:49.159 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-07-22T15:22:49.814 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 2/8 2023-07-22T15:22:49.999 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-07-22T15:22:50.639 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 3/8 2023-07-22T15:22:50.832 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.15-3.el8.x86_64 4/8 2023-07-22T15:22:51.553 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 4/8 2023-07-22T15:22:51.866 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-07-22T15:22:52.041 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-07-22T15:22:53.945 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-07-22T15:22:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 7/8 2023-07-22T15:22:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:18.1.2-167.g1bf364b9 8/8 2023-07-22T15:22:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.1.2-167.g1bf364b9 8/8 2023-07-22T15:22:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.1.2-167.g1bf364b9 1/8 2023-07-22T15:22:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d 2/8 2023-07-22T15:22:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 3/8 2023-07-22T15:22:55.711 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 4/8 2023-07-22T15:22:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 5/8 2023-07-22T15:22:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 6/8 2023-07-22T15:22:55.712 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 7/8 2023-07-22T15:22:56.794 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 8/8 2023-07-22T15:22:56.794 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:04:45 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:22:59.428 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:22:59.630 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:22:59.630 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:22:59.630 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:22:59.630 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-22T15:22:59.631 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-22T15:22:59.631 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-22T15:22:59.631 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-22T15:22:59.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-22T15:22:59.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-22T15:22:59.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-22T15:22:59.631 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:22:59.632 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:22:59.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-rook 2023-07-22T15:23:00.150 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:23:01.092 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:04:50 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:23:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:23:02.658 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================= 2023-07-22T15:23:02.658 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:23:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================= 2023-07-22T15:23:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:23:02.659 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 47 k 2023-07-22T15:23:02.659 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-22T15:23:02.659 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-22T15:23:02.659 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-22T15:23:02.659 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-22T15:23:02.660 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-22T15:23:02.660 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-22T15:23:02.660 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-22T15:23:02.660 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-22T15:23:02.660 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-22T15:23:02.660 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-22T15:23:02.660 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-22T15:23:02.661 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-22T15:23:02.661 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-22T15:23:02.661 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:23:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:23:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================================= 2023-07-22T15:23:02.661 INFO:teuthology.orchestra.run.smithi037.stdout:Install 13 Packages 2023-07-22T15:23:02.661 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:23:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 1.9 M 2023-07-22T15:23:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 25 M 2023-07-22T15:23:02.662 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:23:03.308 INFO:teuthology.orchestra.run.smithi037.stdout:(1/13): python3-cachetools-3.1.1-4.el8.noarch.r 132 kB/s | 33 kB 00:00 2023-07-22T15:23:03.325 INFO:teuthology.orchestra.run.smithi037.stdout:(2/13): python3-certifi-2018.10.15-7.el8.noarch 61 kB/s | 16 kB 00:00 2023-07-22T15:23:03.375 INFO:teuthology.orchestra.run.smithi037.stdout:(3/13): ceph-mgr-rook-18.1.2-167.g1bf364b9.el8. 150 kB/s | 47 kB 00:00 2023-07-22T15:23:03.417 INFO:teuthology.orchestra.run.smithi037.stdout:(4/13): python3-google-auth-1.1.1-10.el8.noarch 745 kB/s | 81 kB 00:00 2023-07-22T15:23:03.515 INFO:teuthology.orchestra.run.smithi037.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 657 kB/s | 61 kB 00:00 2023-07-22T15:23:03.676 INFO:teuthology.orchestra.run.smithi037.stdout:(6/13): python3-kubernetes-11.0.0-6.el8.noarch. 3.3 MB/s | 1.2 MB 00:00 2023-07-22T15:23:03.701 INFO:teuthology.orchestra.run.smithi037.stdout:(7/13): python3-rsa-4.8-1.el8.noarch.rpm 189 kB/s | 61 kB 00:00 2023-07-22T15:23:03.738 INFO:teuthology.orchestra.run.smithi037.stdout:(8/13): python3-pyasn1-modules-0.3.7-6.el8.noar 504 kB/s | 110 kB 00:00 2023-07-22T15:23:03.785 INFO:teuthology.orchestra.run.smithi037.stdout:(9/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 244 kB/s | 27 kB 00:00 2023-07-22T15:23:03.811 INFO:teuthology.orchestra.run.smithi037.stdout:(10/13): python3-jsonpointer-1.10-11.el8.noarch 298 kB/s | 20 kB 00:00 2023-07-22T15:23:03.838 INFO:teuthology.orchestra.run.smithi037.stdout:(11/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2023-07-22T15:23:03.953 INFO:teuthology.orchestra.run.smithi037.stdout:(12/13): python3-requests-oauthlib-1.0.0-1.el8. 256 kB/s | 43 kB 00:00 2023-07-22T15:23:03.995 INFO:teuthology.orchestra.run.smithi037.stdout:(13/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 843 kB/s | 155 kB 00:00 2023-07-22T15:23:04.002 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:23:04.002 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.4 MB/s | 1.9 MB 00:01 2023-07-22T15:23:04.066 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:23:04.083 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:23:04.083 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:23:04.162 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:23:04.165 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:23:04.667 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:23:04.874 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-07-22T15:23:05.152 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.8-1.el8.noarch 2/13 2023-07-22T15:23:05.380 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2023-07-22T15:23:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2023-07-22T15:23:05.804 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2023-07-22T15:23:05.980 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2023-07-22T15:23:06.119 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2023-07-22T15:23:06.305 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2023-07-22T15:23:06.514 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-07-22T15:23:06.716 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2023-07-22T15:23:08.028 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2023-07-22T15:23:08.223 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2023-07-22T15:23:08.397 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:18.1.2-167.g1bf364b9.el8.noarch 13/13 2023-07-22T15:23:08.626 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:18.1.2-167.g1bf364b9.el8.noarch 13/13 2023-07-22T15:23:08.626 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:18.1.2-167.g1bf364b9.el8.noarch 1/13 2023-07-22T15:23:08.626 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2023-07-22T15:23:08.626 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2023-07-22T15:23:08.626 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2023-07-22T15:23:08.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2023-07-22T15:23:08.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 6/13 2023-07-22T15:23:08.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2023-07-22T15:23:08.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 8/13 2023-07-22T15:23:08.627 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 9/13 2023-07-22T15:23:08.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 10/13 2023-07-22T15:23:08.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-07-22T15:23:08.628 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 12/13 2023-07-22T15:23:09.804 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 13/13 2023-07-22T15:23:09.805 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:04:58 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:23:14.846 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:23:15.050 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:23:15.050 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:23:15.050 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:23:15.050 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-22T15:23:15.051 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-22T15:23:15.051 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-22T15:23:15.051 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-22T15:23:15.051 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-22T15:23:15.051 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-22T15:23:15.052 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-22T15:23:15.052 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-22T15:23:15.052 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-22T15:23:15.052 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-22T15:23:15.053 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-22T15:23:15.053 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-22T15:23:15.053 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:23:15.054 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:23:15.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-cephadm 2023-07-22T15:23:15.571 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:23:17.041 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:05:06 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:23:18.608 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:23:18.609 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================== 2023-07-22T15:23:18.609 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:23:18.609 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================== 2023-07-22T15:23:18.609 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:23:18.610 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 127 k 2023-07-22T15:23:18.610 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-22T15:23:18.610 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-22T15:23:18.610 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-22T15:23:18.610 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-22T15:23:18.611 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-22T15:23:18.611 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:23:18.611 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:23:18.611 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================================== 2023-07-22T15:23:18.612 INFO:teuthology.orchestra.run.smithi037.stdout:Install 5 Packages 2023-07-22T15:23:18.612 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:23:18.613 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 6.0 M 2023-07-22T15:23:18.613 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 26 M 2023-07-22T15:23:18.613 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:23:19.287 INFO:teuthology.orchestra.run.smithi037.stdout:(1/5): ceph-mgr-cephadm-18.1.2-167.g1bf364b9.el 421 kB/s | 127 kB 00:00 2023-07-22T15:23:19.462 INFO:teuthology.orchestra.run.smithi037.stdout:(2/5): python3-jinja2-2.10.1-3.el8.noarch.rpm 3.0 MB/s | 538 kB 00:00 2023-07-22T15:23:19.695 INFO:teuthology.orchestra.run.smithi037.stdout:(3/5): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-07-22T15:25:31.298 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] python3-asyncssh-2.7.0-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-asyncssh-2.7.0-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-22T15:25:31.299 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] python3-natsort-7.1.1-2.el8.noarch.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/p/python3-natsort-7.1.1-2.el8.noarch.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-07-22T15:25:31.846 INFO:teuthology.orchestra.run.smithi037.stdout:(4/5): python3-natsort-7.1.1-2.el8.noarch.rpm 464 B/s | 60 kB 02:12 2023-07-22T15:25:32.138 INFO:teuthology.orchestra.run.smithi037.stdout:(5/5): python3-asyncssh-2.7.0-2.el8.noarch.rpm 3.6 kB/s | 476 kB 02:13 2023-07-22T15:25:32.139 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:25:32.140 INFO:teuthology.orchestra.run.smithi037.stdout:Total 46 kB/s | 6.0 MB 02:13 2023-07-22T15:25:32.196 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:25:32.209 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:25:32.209 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:25:32.294 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:25:32.298 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:25:33.333 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:25:33.740 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 1/5 2023-07-22T15:25:33.998 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 2/5 2023-07-22T15:25:34.317 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-07-22T15:25:34.602 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 4/5 2023-07-22T15:25:34.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 5/5 2023-07-22T15:25:35.020 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 5/5 2023-07-22T15:25:35.021 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 1/5 2023-07-22T15:25:35.021 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 2/5 2023-07-22T15:25:35.021 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 3/5 2023-07-22T15:25:35.021 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 4/5 2023-07-22T15:25:36.107 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 5/5 2023-07-22T15:25:36.107 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:07:25 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:25:42.243 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:25:42.443 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:25:42.444 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:25:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:25:42.444 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-22T15:25:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-22T15:25:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-22T15:25:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-22T15:25:42.445 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:25:42.445 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:25:42.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-fuse 2023-07-22T15:25:42.975 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:25:44.534 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:07:33 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:25:46.081 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:25:46.082 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:25:46.082 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:25:46.083 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:25:46.083 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:25:46.083 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse 2023-07-22T15:25:46.083 INFO:teuthology.orchestra.run.smithi037.stdout: x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 846 k 2023-07-22T15:25:46.083 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-07-22T15:25:46.083 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-22T15:25:46.083 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:25:46.084 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:25:46.084 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:25:46.084 INFO:teuthology.orchestra.run.smithi037.stdout:Install 2 Packages 2023-07-22T15:25:46.084 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:25:46.084 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 929 k 2023-07-22T15:25:46.085 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 3.0 M 2023-07-22T15:25:46.085 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:25:46.304 INFO:teuthology.orchestra.run.smithi037.stdout:(1/2): fuse-2.9.7-15.el8.x86_64.rpm 376 kB/s | 83 kB 00:00 2023-07-22T15:25:46.704 INFO:teuthology.orchestra.run.smithi037.stdout:(2/2): ceph-fuse-18.1.2-167.g1bf364b9.el8.x86_6 1.3 MB/s | 846 kB 00:00 2023-07-22T15:25:46.705 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:25:46.705 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.5 MB/s | 929 kB 00:00 2023-07-22T15:25:46.718 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:25:46.742 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:25:46.742 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:25:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:25:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:25:47.004 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:25:47.338 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.7-15.el8.x86_64 1/2 2023-07-22T15:25:47.500 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:18.1.2-167.g1bf364b9.el8.x86_64 2/2 2023-07-22T15:25:47.854 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-fuse-2:18.1.2-167.g1bf364b9.el8.x86_64 2/2 2023-07-22T15:25:47.855 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:18.1.2-167.g1bf364b9.el8.x86_64 1/2 2023-07-22T15:25:48.939 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 2/2 2023-07-22T15:25:48.939 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:07:37 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:25:53.825 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:25:54.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:25:54.028 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:25:54.028 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:18.1.2-167.g1bf364b9.el8.x86_64 fuse-2.9.7-15.el8.x86_64 2023-07-22T15:25:54.028 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:25:54.028 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:25:54.170 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-volume 2023-07-22T15:25:54.547 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:25:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:07:45 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:25:57.834 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:25:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:25:57.835 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-07-22T15:25:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:25:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:25:57.835 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:18.1.2-167.g1bf364b9.el8 ceph-noarch 258 k 2023-07-22T15:25:57.836 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:25:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:25:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:25:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2023-07-22T15:25:57.836 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:25:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 258 k 2023-07-22T15:25:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 1.2 M 2023-07-22T15:25:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:25:58.218 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-volume-18.1.2-167.g1bf364b9.el8.noarch.rpm 677 kB/s | 258 kB 00:00 2023-07-22T15:25:58.218 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:25:58.219 INFO:teuthology.orchestra.run.smithi037.stdout:Total 675 kB/s | 258 kB 00:00 2023-07-22T15:25:58.219 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:25:58.230 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:25:58.230 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:25:58.249 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:25:58.253 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:25:58.428 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:25:58.684 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:18.1.2-167.g1bf364b9.el8.noarch 1/1 2023-07-22T15:25:59.035 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:18.1.2-167.g1bf364b9.el8.noarch 1/1 2023-07-22T15:26:00.108 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:18.1.2-167.g1bf364b9.el8.noarch 1/1 2023-07-22T15:26:00.108 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:07:49 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:06.824 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:26:07.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:07.022 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:26:07.022 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:18.1.2-167.g1bf364b9.el8.noarch 2023-07-22T15:26:07.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:07.023 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:07.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados-devel 2023-07-22T15:26:07.570 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:26:09.311 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:07:58 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:10.860 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:26:10.861 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:26:10.861 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2023-07-22T15:26:10.861 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:26:10.861 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:26:10.861 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 139 k 2023-07-22T15:26:10.861 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:10.862 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:26:10.862 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:26:10.862 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2023-07-22T15:26:10.862 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:10.862 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 139 k 2023-07-22T15:26:10.863 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 513 k 2023-07-22T15:26:10.863 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:26:11.363 INFO:teuthology.orchestra.run.smithi037.stdout:librados-devel-18.1.2-167.g1bf364b9.el8.x86_64. 277 kB/s | 139 kB 00:00 2023-07-22T15:26:11.364 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:26:11.364 INFO:teuthology.orchestra.run.smithi037.stdout:Total 277 kB/s | 139 kB 00:00 2023-07-22T15:26:11.364 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:26:11.370 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:26:11.371 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:26:11.431 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:26:11.435 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:26:11.561 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:26:11.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:26:11.946 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados-devel-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:26:13.044 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:26:13.044 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:02 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:20.541 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:26:20.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:20.739 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:26:20.739 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:26:20.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:20.740 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:20.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs2 2023-07-22T15:26:21.289 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:26:22.923 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:11 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:24.276 INFO:teuthology.orchestra.run.smithi037.stdout:Package libcephfs2-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:26:24.395 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:26:24.396 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:26:24.396 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:24.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs-devel 2023-07-22T15:26:24.890 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:26:26.435 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:15 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:27.976 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:26:27.977 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:26:27.977 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2023-07-22T15:26:27.977 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:26:27.977 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:26:27.978 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 30 k 2023-07-22T15:26:27.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:27.978 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:26:27.978 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:26:27.978 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2023-07-22T15:26:27.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:27.979 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 30 k 2023-07-22T15:26:27.979 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 137 k 2023-07-22T15:26:27.979 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:26:28.301 INFO:teuthology.orchestra.run.smithi037.stdout:libcephfs-devel-18.1.2-167.g1bf364b9.el8.x86_64 94 kB/s | 30 kB 00:00 2023-07-22T15:26:28.302 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:26:28.302 INFO:teuthology.orchestra.run.smithi037.stdout:Total 94 kB/s | 30 kB 00:00 2023-07-22T15:26:28.303 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:26:28.307 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:26:28.307 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:26:28.318 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:26:28.323 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:26:28.415 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:26:28.594 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:26:28.807 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs-devel-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:26:29.858 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:26:29.858 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:18 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:39.449 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:26:39.649 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:39.650 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:26:39.650 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:26:39.650 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:26:39.651 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:39.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2023-07-22T15:26:40.199 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:26:42.101 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:31 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:43.534 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:26:43.653 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:26:43.654 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:26:43.654 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:43.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librbd1 2023-07-22T15:26:44.156 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:26:45.786 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:34 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:47.190 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:26:47.310 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:26:47.311 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:26:47.311 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:47.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rados 2023-07-22T15:26:47.809 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:26:49.418 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:38 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:50.845 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rados-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:26:50.964 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:26:50.965 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:26:50.965 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:51.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rgw 2023-07-22T15:26:51.459 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:26:53.130 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:42 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:54.543 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rgw-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:26:54.661 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:26:54.662 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:26:54.662 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:54.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-cephfs 2023-07-22T15:26:55.156 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:26:56.745 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:45 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:26:58.174 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-cephfs-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:26:58.293 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:26:58.295 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:26:58.295 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:26:58.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rbd 2023-07-22T15:26:58.787 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:27:00.368 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:49 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:27:01.780 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rbd-2:18.1.2-167.g1bf364b9.el8.x86_64 is already installed. 2023-07-22T15:27:01.898 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:27:01.899 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2023-07-22T15:27:01.899 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:27:02.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-fuse 2023-07-22T15:27:02.396 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:27:03.975 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:52 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:27:05.530 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:27:05.531 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:05.531 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2023-07-22T15:27:05.531 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:05.531 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:27:05.531 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 94 k 2023-07-22T15:27:05.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:05.532 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:27:05.532 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:05.532 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2023-07-22T15:27:05.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:05.533 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 94 k 2023-07-22T15:27:05.533 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 280 k 2023-07-22T15:27:05.533 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:27:06.004 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-fuse-18.1.2-167.g1bf364b9.el8.x86_64.rpm 200 kB/s | 94 kB 00:00 2023-07-22T15:27:06.004 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:27:06.004 INFO:teuthology.orchestra.run.smithi037.stdout:Total 200 kB/s | 94 kB 00:00 2023-07-22T15:27:06.005 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:27:06.017 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:27:06.017 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:27:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:27:06.081 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:27:06.197 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:27:06.364 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:06.598 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-fuse-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:07.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:07.700 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:08:56 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:27:17.771 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:27:17.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:17.969 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:27:17.969 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:27:17.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:17.969 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:27:18.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-mirror 2023-07-22T15:27:18.485 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:27:20.221 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:09:09 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:27:21.752 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:27:21.752 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:21.752 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2023-07-22T15:27:21.752 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:21.753 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:27:21.753 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 3.4 M 2023-07-22T15:27:21.753 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:21.753 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:27:21.753 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:21.753 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2023-07-22T15:27:21.753 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:21.754 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 3.4 M 2023-07-22T15:27:21.754 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 16 M 2023-07-22T15:27:21.754 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:27:25.331 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-mirror-18.1.2-167.g1bf364b9.el8.x86_64.rpm 987 kB/s | 3.4 MB 00:03 2023-07-22T15:27:25.331 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:27:25.332 INFO:teuthology.orchestra.run.smithi037.stdout:Total 987 kB/s | 3.4 MB 00:03 2023-07-22T15:27:25.332 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:27:25.348 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:27:25.348 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:27:25.424 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:27:25.428 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:27:25.902 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:27:26.106 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:26.496 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:27.564 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:27.564 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:09:16 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:27:35.206 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:27:35.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:35.402 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:27:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:27:35.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:35.402 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:27:35.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-nbd 2023-07-22T15:27:35.955 INFO:teuthology.orchestra.run.smithi037.stdout:Updating Subscription Management repositories. 2023-07-22T15:27:37.490 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:09:26 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:27:39.043 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-07-22T15:27:39.044 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:39.044 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2023-07-22T15:27:39.044 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:39.044 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-07-22T15:27:39.044 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:18.1.2-167.g1bf364b9.el8 ceph 179 k 2023-07-22T15:27:39.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:39.045 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-07-22T15:27:39.045 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-07-22T15:27:39.045 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2023-07-22T15:27:39.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:39.045 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 179 k 2023-07-22T15:27:39.045 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 568 k 2023-07-22T15:27:39.046 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-07-22T15:27:39.792 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-nbd-18.1.2-167.g1bf364b9.el8.x86_64.rpm 240 kB/s | 179 kB 00:00 2023-07-22T15:27:39.792 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-07-22T15:27:39.793 INFO:teuthology.orchestra.run.smithi037.stdout:Total 240 kB/s | 179 kB 00:00 2023-07-22T15:27:39.793 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-07-22T15:27:39.807 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-07-22T15:27:39.807 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-07-22T15:27:39.872 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-07-22T15:27:39.877 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-07-22T15:27:39.997 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-07-22T15:27:40.135 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:40.391 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-nbd-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:41.447 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:18.1.2-167.g1bf364b9.el8.x86_64 1/1 2023-07-22T15:27:41.448 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:09:30 ago on Sat 22 Jul 2023 03:18:11 PM UTC. 2023-07-22T15:27:49.343 INFO:teuthology.orchestra.run.smithi037.stdout:Installed products updated. 2023-07-22T15:27:49.545 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:49.545 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-07-22T15:27:49.546 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:18.1.2-167.g1bf364b9.el8.x86_64 2023-07-22T15:27:49.546 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:49.546 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-07-22T15:27:49.895 DEBUG:teuthology.parallel:result is None 2023-07-22T15:27:49.896 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1bf364b918a7ab4708130a64bf96639942959f6d 2023-07-22T15:27:50.301 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-22T15:27:50.325 INFO:teuthology.orchestra.run.smithi037.stdout:18.1.2-167.g1bf364b9.el8 2023-07-22T15:27:50.326 INFO:teuthology.packaging:The installed version of ceph is 18.1.2-167.g1bf364b9.el8 2023-07-22T15:27:50.326 INFO:teuthology.task.install:The correct ceph version 18.1.2-167.g1bf364b9 is installed. 2023-07-22T15:27:50.326 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-22T15:27:50.327 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:50.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-22T15:27:50.393 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-22T15:27:50.393 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:50.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-07-22T15:27:50.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-22T15:27:50.526 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-22T15:27:50.527 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:50.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-22T15:27:50.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-22T15:27:50.661 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-22T15:27:50.661 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:50.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-07-22T15:27:50.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-22T15:27:50.793 INFO:teuthology.run_tasks:Running task ceph... 2023-07-22T15:27:50.867 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-22T15:27:50.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-07-22T15:27:50.895 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-22T15:27:50.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-22T15:27:50.962 INFO:tasks.ceph:Creating extra log directories... 2023-07-22T15:27:50.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-22T15:27:51.036 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-22T15:27:51.037 INFO:tasks.ceph:config {'conf': {'client': {'rbd default features': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-22T15:27:51.037 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-07-22_15:03:05-rbd-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi/7348020', 'branch': 'wip-yuri10-testing-2023-07-21-0828-reef', 'description': 'rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_migration}', 'email': None, 'first_in_suite': False, 'job_id': '7348020', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-07-22_15:03:05-rbd-wip-yuri10-testing-2023-07-21-0828-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-yuri10-testing-2023-07-21-0828-reef'}, 'ceph': {'conf': {'client': {'rbd default features': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': '1bf364b918a7ab4708130a64bf96639942959f6d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1bf364b918a7ab4708130a64bf96639942959f6d'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri10-testing-2023-07-21-0828-reef', 'sha1': '1bf364b918a7ab4708130a64bf96639942959f6d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 95, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 9766, 'sha1': '1bf364b918a7ab4708130a64bf96639942959f6d', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri10-testing-2023-07-21-0828-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1bf364b918a7ab4708130a64bf96639942959f6d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1bf364b918a7ab4708130a64bf96639942959f6d', 'targets': {'smithi037.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_migration.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1426592083662fef3e03bbeec33624331f0fdbc1', 'timestamp': '2023-07-22_15:03:05', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-22T15:27:51.038 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-22T15:27:51.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-07-22T15:27:51.152 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:51.153 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-07-22T15:27:51.209 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-22T15:27:51.210 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-07-22T15:27:51.266 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-22T15:27:51.267 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-22T15:27:51.267 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 378629 Links: 1 2023-07-22T15:27:51.267 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-22T15:27:51.267 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-22T15:27:51.267 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-22 15:27:26.278795149 +0000 2023-07-22T15:27:51.267 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-22 15:17:22.909429065 +0000 2023-07-22T15:27:51.267 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-22 15:17:22.909429065 +0000 2023-07-22T15:27:51.268 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-07-22T15:27:51.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-22T15:27:51.333 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-22T15:27:51.333 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-22T15:27:51.333 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000237467 s, 2.2 MB/s 2023-07-22T15:27:51.334 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-22T15:27:51.392 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-07-22T15:27:51.450 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-22T15:27:51.450 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-22T15:27:51.450 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 381090 Links: 1 2023-07-22T15:27:51.450 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-22T15:27:51.450 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-22T15:27:51.451 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-22 15:27:26.278795149 +0000 2023-07-22T15:27:51.451 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-22 15:17:23.496421078 +0000 2023-07-22T15:27:51.451 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-22 15:17:23.496421078 +0000 2023-07-22T15:27:51.451 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-07-22T15:27:51.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-22T15:27:51.515 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-22T15:27:51.515 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-22T15:27:51.516 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000254083 s, 2.0 MB/s 2023-07-22T15:27:51.516 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-22T15:27:51.574 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-07-22T15:27:51.631 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-22T15:27:51.632 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-22T15:27:51.632 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 373341 Links: 1 2023-07-22T15:27:51.632 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-22T15:27:51.632 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-22T15:27:51.632 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-22 15:27:26.278795149 +0000 2023-07-22T15:27:51.633 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-22 15:17:24.074413214 +0000 2023-07-22T15:27:51.633 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-22 15:17:24.074413214 +0000 2023-07-22T15:27:51.633 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-07-22T15:27:51.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-22T15:27:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-22T15:27:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-22T15:27:51.697 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000201038 s, 2.5 MB/s 2023-07-22T15:27:51.698 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-22T15:27:51.757 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-07-22T15:27:51.813 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-22T15:27:51.814 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-22T15:27:51.814 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 372430 Links: 1 2023-07-22T15:27:51.814 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-22T15:27:51.814 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-07-22T15:27:51.814 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-22 15:27:26.278795149 +0000 2023-07-22T15:27:51.815 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-22 15:17:24.619405799 +0000 2023-07-22T15:27:51.815 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-22 15:17:24.619405799 +0000 2023-07-22T15:27:51.815 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2023-07-22T15:27:51.815 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-22T15:27:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-22T15:27:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-22T15:27:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000226043 s, 2.3 MB/s 2023-07-22T15:27:51.880 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-22T15:27:51.938 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-07-22T15:27:51.939 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-07-22T15:27:51.939 INFO:tasks.ceph:Generating config... 2023-07-22T15:27:51.940 INFO:tasks.ceph:[client] rbd default features = 1 2023-07-22T15:27:51.940 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-07-22T15:27:51.941 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-07-22T15:27:51.941 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-22T15:27:51.941 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-22T15:27:51.941 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-22T15:27:51.941 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-22T15:27:51.942 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-22T15:27:51.942 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-22T15:27:51.942 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2023-07-22T15:27:51.942 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-07-22T15:27:51.942 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-22T15:27:51.943 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-22T15:27:51.943 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-22T15:27:51.943 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-22T15:27:51.943 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-22T15:27:51.943 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-22T15:27:51.943 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-22T15:27:51.944 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-22T15:27:51.944 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-22T15:27:51.944 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-22T15:27:51.944 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-22T15:27:51.944 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-07-22T15:27:51.945 INFO:tasks.ceph:Setting up mon.a... 2023-07-22T15:27:51.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-22T15:27:52.043 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-07-22T15:27:52.045 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-22T15:27:52.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-22T15:27:52.118 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37')] 2023-07-22T15:27:52.119 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default features': 1}, 'mon.a': {}} 2023-07-22T15:27:52.119 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:52.120 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-22T15:27:52.174 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --print /home/ubuntu/cephtest/ceph.monmap 2023-07-22T15:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-22T15:27:52.255 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid e9e9f8e5-df97-4b36-8fab-62e956407bb5 2023-07-22T15:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = pacific 2023-07-22T15:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-07-22T15:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout:fsid e9e9f8e5-df97-4b36-8fab-62e956407bb5 2023-07-22T15:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-07-22T15:27:52.256887+0000 2023-07-22T15:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-07-22T15:27:52.256887+0000 2023-07-22T15:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 16 (pacific) 2023-07-22T15:27:52.256 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-07-22T15:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-07-22T15:27:52.257 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-07-22T15:27:52.258 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-22T15:27:52.315 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e9e9f8e5-df97-4b36-8fab-62e956407bb5... 2023-07-22T15:27:52.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-22T15:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-07-22T15:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-07-22T15:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-22T15:27:52.401 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-07-22T15:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-07-22T15:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-07-22T15:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-07-22T15:27:52.402 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-07-22T15:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-07-22T15:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-07-22T15:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-22T15:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-07-22T15:27:52.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-07-22T15:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-22T15:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-07-22T15:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-07-22T15:27:52.404 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-07-22T15:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-07-22T15:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-07-22T15:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-07-22T15:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-07-22T15:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-07-22T15:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-22T15:27:52.405 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-22T15:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-07-22T15:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-22T15:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-07-22T15:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.406 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-07-22T15:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-07-22T15:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-07-22T15:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-07-22T15:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = 172.21.15.37 2023-07-22T15:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: mon client directed command retry = 5 2023-07-22T15:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: ms inject socket failures = 5000 2023-07-22T15:27:52.407 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = e9e9f8e5-df97-4b36-8fab-62e956407bb5 2023-07-22T15:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-07-22T15:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-07-22T15:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-07-22T15:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-07-22T15:27:52.408 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-07-22T15:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-07-22T15:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-07-22T15:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-07-22T15:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-07-22T15:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-07-22T15:27:52.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-07-22T15:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-07-22T15:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-07-22T15:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-07-22T15:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.410 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-07-22T15:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-07-22T15:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-07-22T15:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-07-22T15:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-07-22T15:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-07-22T15:27:52.411 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore compression algorithm = zstd 2023-07-22T15:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore compression mode = aggressive 2023-07-22T15:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-07-22T15:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-07-22T15:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-07-22T15:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-22T15:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-07-22T15:27:52.412 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-07-22T15:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-07-22T15:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-07-22T15:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-07-22T15:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-07-22T15:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-07-22T15:27:52.413 INFO:teuthology.orchestra.run.smithi037.stdout: osd shutdown pgref assert = True 2023-07-22T15:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-07-22T15:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-22T15:27:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-07-22T15:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-22T15:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-22T15:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-22T15:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-22T15:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-07-22T15:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-07-22T15:27:52.415 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-22T15:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-22T15:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-07-22T15:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-22T15:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-07-22T15:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-07-22T15:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-22T15:27:52.416 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-07-22T15:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-07-22T15:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-22T15:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-22T15:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-07-22T15:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-07-22T15:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-07-22T15:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-22T15:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-22T15:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-07-22T15:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-07-22T15:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-07-22T15:27:52.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-07-22T15:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-07-22T15:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-07-22T15:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-07-22T15:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-22T15:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-22T15:27:52.419 INFO:teuthology.orchestra.run.smithi037.stdout: rbd default features = 1 2023-07-22T15:27:52.420 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-07-22T15:27:52.420 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-22T15:27:52.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-22T15:27:52.519 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-22T15:27:52.519 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:52.520 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-22T15:27:52.536 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:52.537 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-22T15:27:52.593 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-07-22T15:27:52.593 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:52.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-22T15:27:52.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-22T15:27:52.669 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:27:52.670 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-22T15:27:52.726 INFO:tasks.ceph:Setting up mon nodes... 2023-07-22T15:27:52.727 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-22T15:27:52.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-22T15:27:52.821 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-22T15:27:52.824 INFO:tasks.ceph:Setting up mds nodes... 2023-07-22T15:27:52.824 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-22T15:27:52.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-22T15:27:52.869 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-22T15:27:52.882 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-22T15:27:52.882 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-07-22T15:27:52.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-22T15:27:52.909 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-07-22T15:27:52.909 INFO:tasks.ceph:role: osd.0 2023-07-22T15:27:52.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-22T15:27:52.910 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-22T15:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-22T15:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-22T15:27:52.983 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-22T15:27:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-22T15:27:52.984 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-22T15:27:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-22T15:27:52.984 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-22T15:27:52.984 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-22T15:27:52.984 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-22T15:27:52.984 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-22T15:27:53.409 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-22T15:27:53.410 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-22T15:27:53.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-22T15:27:53.580 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-22T15:27:53.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-22T15:27:53.686 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-07-22T15:27:53.687 INFO:tasks.ceph:role: osd.1 2023-07-22T15:27:53.687 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-22T15:27:53.687 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-22T15:27:53.763 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-22T15:27:53.763 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-22T15:27:53.763 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-22T15:27:53.764 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-22T15:27:53.764 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-22T15:27:53.764 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-22T15:27:53.765 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-22T15:27:53.765 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-22T15:27:53.765 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-22T15:27:53.765 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-22T15:27:54.187 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-22T15:27:54.189 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-22T15:27:54.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-22T15:27:54.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-22T15:27:54.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-22T15:27:54.404 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-07-22T15:27:54.405 INFO:tasks.ceph:role: osd.2 2023-07-22T15:27:54.405 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-22T15:27:54.405 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-22T15:27:54.481 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-22T15:27:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-22T15:27:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-22T15:27:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-22T15:27:54.482 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-22T15:27:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-22T15:27:54.482 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-22T15:27:54.482 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-22T15:27:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-22T15:27:54.482 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-22T15:27:54.927 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-22T15:27:54.929 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-22T15:27:54.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-22T15:27:55.105 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-22T15:27:55.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-22T15:27:55.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:55.256+0000 7f12d0a3e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-22T15:27:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:55.258+0000 7f12d0a3e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-22T15:27:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:55.258+0000 7f12d0a3e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-22T15:27:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:55.258+0000 7f12d0a3e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-22T15:27:55.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:55.258+0000 7f12d0a3e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-22T15:27:55.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:55.265+0000 7f12d0a3e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-22T15:27:58.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-22T15:27:58.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-22T15:27:58.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:58.274+0000 7f2113a05640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-22T15:27:58.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:58.274+0000 7f2113a05640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-22T15:27:58.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:58.275+0000 7f2113a05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-22T15:27:58.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:58.275+0000 7f2113a05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-22T15:27:58.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:58.275+0000 7f2113a05640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-22T15:27:58.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:27:58.275+0000 7f2113a05640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-22T15:28:01.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-22T15:28:01.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-22T15:28:01.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:28:01.273+0000 7fcf0a6b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-22T15:28:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:28:01.273+0000 7fcf0a6b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-22T15:28:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:28:01.273+0000 7fcf0a6b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-22T15:28:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:28:01.273+0000 7fcf0a6b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-22T15:28:01.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:28:01.273+0000 7fcf0a6b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-22T15:28:01.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-22T15:28:01.274+0000 7fcf0a6b2640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-22T15:28:04.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-22T15:28:04.171 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-22T15:28:04.171 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:28:04.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-22T15:28:04.243 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:28:04.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-22T15:28:04.315 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:28:04.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-22T15:28:04.388 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:28:04.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-22T15:28:04.459 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:28:04.459 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-22T15:28:04.519 INFO:tasks.ceph:Adding keys to all mons... 2023-07-22T15:28:04.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-22T15:28:04.590 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-07-22T15:28:04.590 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB49btkJJARMRAAl6BtwJpTyhR/7rJ5tm0xNg== 2023-07-22T15:28:04.590 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-07-22T15:28:04.590 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB79btkmMlZDxAAmw7e9D/FrgAqwpqNg7JnAg== 2023-07-22T15:28:04.591 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-07-22T15:28:04.591 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB+9btkQYN0EBAAoPHjSshUbKpONbJz0Asp4w== 2023-07-22T15:28:04.591 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-07-22T15:28:04.591 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQCB9btkLhJkEBAAQCuUWpDYqwSFe4e6m8sCTw== 2023-07-22T15:28:04.591 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-22T15:28:04.591 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB49btka2PlMxAAbfVBXIVQHS0ORFWyVgPc2Q== 2023-07-22T15:28:04.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-22T15:28:04.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-22T15:28:04.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-22T15:28:04.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-22T15:28:04.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-22T15:28:04.917 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-22T15:28:04.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-22T15:28:04.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-22T15:28:05.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-22T15:28:05.071 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-22T15:28:05.127 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-22T15:28:05.128 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-22T15:28:05.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-22T15:28:05.170 INFO:tasks.ceph.mon.a:Started 2023-07-22T15:28:05.170 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-22T15:28:05.170 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-22T15:28:05.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-22T15:28:05.172 INFO:tasks.ceph.mgr.x:Started 2023-07-22T15:28:05.173 INFO:tasks.ceph:Setting crush tunables to default 2023-07-22T15:28:05.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-07-22T15:28:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-07-22T15:28:05.428 INFO:tasks.ceph:check_enable_crimson: False 2023-07-22T15:28:05.428 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-22T15:28:05.429 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:28:05.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-22T15:28:05.456 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:28:05.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-22T15:28:05.523 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:28:05.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-22T15:28:05.571 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:05.573+0000 7f4435f0d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-22T15:28:05.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 7195c24e-4a01-454b-9097-136a300b84fc 0 2023-07-22T15:28:05.641 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:05.642+0000 7f4435f0d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-22T15:28:05.723 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:05.724+0000 7f4435f0d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-22T15:28:05.809 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:05.810+0000 7f4435f0d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-22T15:28:05.853 INFO:teuthology.orchestra.run.smithi037.stdout:0 2023-07-22T15:28:05.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new b9ef394e-ea89-4500-8b14-42b7daf8af5e 1 2023-07-22T15:28:05.961 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:05.962+0000 7f4435f0d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-22T15:28:06.126 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-22T15:28:06.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd new 1799bdfd-3b18-4c94-8b8e-c89d7b61fc74 2 2023-07-22T15:28:06.332 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:06.332+0000 7f4435f0d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-22T15:28:06.365 INFO:teuthology.orchestra.run.smithi037.stdout:2 2023-07-22T15:28:06.377 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-22T15:28:06.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-22T15:28:06.379 INFO:tasks.ceph.osd.0:Started 2023-07-22T15:28:06.380 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-22T15:28:06.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-22T15:28:06.382 INFO:tasks.ceph.osd.1:Started 2023-07-22T15:28:06.382 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-22T15:28:06.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-22T15:28:06.384 INFO:tasks.ceph.osd.2:Started 2023-07-22T15:28:06.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-22T15:28:06.424 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:06.425+0000 7f4435f0d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-22T15:28:06.561 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:06.562+0000 7f4435f0d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-22T15:28:06.603 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:28:06.603 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"fsid":"e9e9f8e5-df97-4b36-8fab-62e956407bb5","created":"2023-07-22T15:28:05.314153+0000","modified":"2023-07-22T15:28:06.363132+0000","last_up_change":"0.000000","last_in_change":"2023-07-22T15:28:06.363132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7195c24e-4a01-454b-9097-136a300b84fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b9ef394e-ea89-4500-8b14-42b7daf8af5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1799bdfd-3b18-4c94-8b8e-c89d7b61fc74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-22T15:28:06.615 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-22T15:28:06.616 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-22T15:28:06.652 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:06.653+0000 7f4435f0d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-22T15:28:06.918 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-22T15:28:06.999 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-22T15:28:07.000+0000 7f3dc6217640 -1 Falling back to public interface 2023-07-22T15:28:07.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:28:07.015+0000 7f7f3da39640 -1 Falling back to public interface 2023-07-22T15:28:07.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:28:07.015+0000 7fefcdcb2640 -1 Falling back to public interface 2023-07-22T15:28:07.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:28:07.016+0000 7f7f34df7700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6808/0: (98) Address already in use 2023-07-22T15:28:07.097 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:07.098+0000 7f4435f0d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-22T15:28:07.114 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-22T15:28:07.115 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":5,"fsid":"e9e9f8e5-df97-4b36-8fab-62e956407bb5","created":"2023-07-22T15:28:05.314153+0000","modified":"2023-07-22T15:28:06.363132+0000","last_up_change":"0.000000","last_in_change":"2023-07-22T15:28:06.363132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7195c24e-4a01-454b-9097-136a300b84fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b9ef394e-ea89-4500-8b14-42b7daf8af5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1799bdfd-3b18-4c94-8b8e-c89d7b61fc74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-22T15:28:07.126 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-07-22T15:28:07.693 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:07.694+0000 7f4435f0d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-22T15:28:07.854 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:07.855+0000 7f4435f0d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-22T15:28:08.565 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:08.565+0000 7f4435f0d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-22T15:28:08.644 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:08.645+0000 7f4435f0d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-22T15:28:08.790 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:08.791+0000 7f4435f0d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-22T15:28:09.032 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:09.033+0000 7f4435f0d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-22T15:28:09.110 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:09.110+0000 7f4435f0d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-22T15:28:09.400 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:09.401+0000 7f4435f0d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-22T15:28:09.634 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:09.634+0000 7f4435f0d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-22T15:28:09.806 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:09.807+0000 7f4435f0d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-22T15:28:09.951 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:09.952+0000 7f4435f0d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-22T15:28:10.296 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:10.297+0000 7f4435f0d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-22T15:28:10.399 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:10.401+0000 7f4435f0d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-22T15:28:10.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:28:10.528+0000 7fefcdcb2640 -1 osd.2 0 log_to_monitors true 2023-07-22T15:28:10.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:28:10.544+0000 7f7f3da39640 -1 osd.1 0 log_to_monitors true 2023-07-22T15:28:10.544 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-22T15:28:10.545+0000 7f3dc6217640 -1 osd.0 0 log_to_monitors true 2023-07-22T15:28:10.602 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:10.603+0000 7f4435f0d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-22T15:28:11.218 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:11.219+0000 7f4435f0d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-22T15:28:12.239 INFO:tasks.ceph.mgr.x.smithi037.stderr:2023-07-22T15:28:12.240+0000 7f43ee13a700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-07-22T15:28:13.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:28:13.319+0000 7fefc206a700 -1 osd.2 0 waiting for initial osdmap 2023-07-22T15:28:13.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:28:13.320+0000 7f7f31df1700 -1 osd.1 0 waiting for initial osdmap 2023-07-22T15:28:13.323 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-22T15:28:13.324+0000 7f3dba5cf700 -1 osd.0 0 waiting for initial osdmap 2023-07-22T15:28:13.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:28:13.334+0000 7f7f299cb700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-22T15:28:13.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:28:13.334+0000 7fefb9c44700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-22T15:28:13.337 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-22T15:28:13.338+0000 7f3db21a9700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-22T15:28:13.429 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-22T15:28:13.752 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-22T15:28:13.752 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":7,"fsid":"e9e9f8e5-df97-4b36-8fab-62e956407bb5","created":"2023-07-22T15:28:05.314153+0000","modified":"2023-07-22T15:28:12.265919+0000","last_up_change":"0.000000","last_in_change":"2023-07-22T15:28:06.363132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7195c24e-4a01-454b-9097-136a300b84fc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b9ef394e-ea89-4500-8b14-42b7daf8af5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1799bdfd-3b18-4c94-8b8e-c89d7b61fc74","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-22T15:28:13.765 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-07-22T15:28:20.068 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-22T15:28:20.405 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-22T15:28:20.405 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":11,"fsid":"e9e9f8e5-df97-4b36-8fab-62e956407bb5","created":"2023-07-22T15:28:05.314153+0000","modified":"2023-07-22T15:28:17.330370+0000","last_up_change":"2023-07-22T15:28:14.326112+0000","last_in_change":"2023-07-22T15:28:06.363132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-22T15:28:15.293913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7195c24e-4a01-454b-9097-136a300b84fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":96726},{"type":"v1","addr":"172.21.15.37:6801","nonce":96726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":96726},{"type":"v1","addr":"172.21.15.37:6803","nonce":96726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":96726},{"type":"v1","addr":"172.21.15.37:6807","nonce":96726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":96726},{"type":"v1","addr":"172.21.15.37:6805","nonce":96726}]},"public_addr":"172.21.15.37:6801/96726","cluster_addr":"172.21.15.37:6803/96726","heartbeat_back_addr":"172.21.15.37:6807/96726","heartbeat_front_addr":"172.21.15.37:6805/96726","state":["exists","up"]},{"osd":1,"uuid":"b9ef394e-ea89-4500-8b14-42b7daf8af5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":96736},{"type":"v1","addr":"172.21.15.37:6811","nonce":96736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":96736},{"type":"v1","addr":"172.21.15.37:6817","nonce":96736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":96736},{"type":"v1","addr":"172.21.15.37:6823","nonce":96736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":96736},{"type":"v1","addr":"172.21.15.37:6821","nonce":96736}]},"public_addr":"172.21.15.37:6811/96736","cluster_addr":"172.21.15.37:6817/96736","heartbeat_back_addr":"172.21.15.37:6823/96736","heartbeat_front_addr":"172.21.15.37:6821/96736","state":["exists","up"]},{"osd":2,"uuid":"1799bdfd-3b18-4c94-8b8e-c89d7b61fc74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":96740},{"type":"v1","addr":"172.21.15.37:6810","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":96740},{"type":"v1","addr":"172.21.15.37:6813","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":96740},{"type":"v1","addr":"172.21.15.37:6820","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":96740},{"type":"v1","addr":"172.21.15.37:6816","nonce":96740}]},"public_addr":"172.21.15.37:6810/96740","cluster_addr":"172.21.15.37:6813/96740","heartbeat_back_addr":"172.21.15.37:6820/96740","heartbeat_front_addr":"172.21.15.37:6816/96740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.565120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.509401+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.547206+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-22T15:28:20.417 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-07-22T15:28:20.418 INFO:tasks.ceph:Creating RBD pool 2023-07-22T15:28:20.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-22T15:28:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2023-07-22T15:28:21.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-22T15:28:22.347 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-22T15:28:22.362 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-22T15:28:22.363 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-22T15:28:22.363 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-22T15:28:22.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-22T15:28:22.364 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-22T15:28:22.765 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:28:22.778 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":96346},{"type":"v1","addr":"172.21.15.37:6825","nonce":96346}]},"active_addr":"172.21.15.37:6825/96346","active_change":"2023-07-22T15:28:11.233253+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph:v18","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2184702173}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3775892952}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":1266794739}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3113155856}]}]} 2023-07-22T15:28:22.781 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-22T15:28:22.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-22T15:28:22.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-22T15:28:23.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:28:23.113 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"fsid":"e9e9f8e5-df97-4b36-8fab-62e956407bb5","created":"2023-07-22T15:28:05.314153+0000","modified":"2023-07-22T15:28:22.338494+0000","last_up_change":"2023-07-22T15:28:14.326112+0000","last_in_change":"2023-07-22T15:28:06.363132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-22T15:28:15.293913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-22T15:28:20.778858+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7195c24e-4a01-454b-9097-136a300b84fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":96726},{"type":"v1","addr":"172.21.15.37:6801","nonce":96726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":96726},{"type":"v1","addr":"172.21.15.37:6803","nonce":96726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":96726},{"type":"v1","addr":"172.21.15.37:6807","nonce":96726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":96726},{"type":"v1","addr":"172.21.15.37:6805","nonce":96726}]},"public_addr":"172.21.15.37:6801/96726","cluster_addr":"172.21.15.37:6803/96726","heartbeat_back_addr":"172.21.15.37:6807/96726","heartbeat_front_addr":"172.21.15.37:6805/96726","state":["exists","up"]},{"osd":1,"uuid":"b9ef394e-ea89-4500-8b14-42b7daf8af5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":96736},{"type":"v1","addr":"172.21.15.37:6811","nonce":96736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":96736},{"type":"v1","addr":"172.21.15.37:6817","nonce":96736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":96736},{"type":"v1","addr":"172.21.15.37:6823","nonce":96736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":96736},{"type":"v1","addr":"172.21.15.37:6821","nonce":96736}]},"public_addr":"172.21.15.37:6811/96736","cluster_addr":"172.21.15.37:6817/96736","heartbeat_back_addr":"172.21.15.37:6823/96736","heartbeat_front_addr":"172.21.15.37:6821/96736","state":["exists","up"]},{"osd":2,"uuid":"1799bdfd-3b18-4c94-8b8e-c89d7b61fc74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":96740},{"type":"v1","addr":"172.21.15.37:6810","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":96740},{"type":"v1","addr":"172.21.15.37:6813","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":96740},{"type":"v1","addr":"172.21.15.37:6820","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":96740},{"type":"v1","addr":"172.21.15.37:6816","nonce":96740}]},"public_addr":"172.21.15.37:6810/96740","cluster_addr":"172.21.15.37:6813/96740","heartbeat_back_addr":"172.21.15.37:6820/96740","heartbeat_front_addr":"172.21.15.37:6816/96740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.565120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.509401+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.547206+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-22T15:28:23.126 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-22T15:28:23.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-22T15:28:23.462 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:28:23.462 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":14,"fsid":"e9e9f8e5-df97-4b36-8fab-62e956407bb5","created":"2023-07-22T15:28:05.314153+0000","modified":"2023-07-22T15:28:23.343404+0000","last_up_change":"2023-07-22T15:28:14.326112+0000","last_in_change":"2023-07-22T15:28:06.363132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-22T15:28:15.293913+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-22T15:28:20.778858+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7195c24e-4a01-454b-9097-136a300b84fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":96726},{"type":"v1","addr":"172.21.15.37:6801","nonce":96726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":96726},{"type":"v1","addr":"172.21.15.37:6803","nonce":96726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":96726},{"type":"v1","addr":"172.21.15.37:6807","nonce":96726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":96726},{"type":"v1","addr":"172.21.15.37:6805","nonce":96726}]},"public_addr":"172.21.15.37:6801/96726","cluster_addr":"172.21.15.37:6803/96726","heartbeat_back_addr":"172.21.15.37:6807/96726","heartbeat_front_addr":"172.21.15.37:6805/96726","state":["exists","up"]},{"osd":1,"uuid":"b9ef394e-ea89-4500-8b14-42b7daf8af5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6809","nonce":96736},{"type":"v1","addr":"172.21.15.37:6811","nonce":96736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":96736},{"type":"v1","addr":"172.21.15.37:6817","nonce":96736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":96736},{"type":"v1","addr":"172.21.15.37:6823","nonce":96736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6819","nonce":96736},{"type":"v1","addr":"172.21.15.37:6821","nonce":96736}]},"public_addr":"172.21.15.37:6811/96736","cluster_addr":"172.21.15.37:6817/96736","heartbeat_back_addr":"172.21.15.37:6823/96736","heartbeat_front_addr":"172.21.15.37:6821/96736","state":["exists","up"]},{"osd":2,"uuid":"1799bdfd-3b18-4c94-8b8e-c89d7b61fc74","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":96740},{"type":"v1","addr":"172.21.15.37:6810","nonce":96740}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":96740},{"type":"v1","addr":"172.21.15.37:6813","nonce":96740}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":96740},{"type":"v1","addr":"172.21.15.37:6820","nonce":96740}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6815","nonce":96740},{"type":"v1","addr":"172.21.15.37:6816","nonce":96740}]},"public_addr":"172.21.15.37:6810/96740","cluster_addr":"172.21.15.37:6813/96740","heartbeat_back_addr":"172.21.15.37:6820/96740","heartbeat_front_addr":"172.21.15.37:6816/96740","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.565120+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.509401+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-22T15:28:11.547206+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-22T15:28:23.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-22T15:28:23.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-22T15:28:23.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-22T15:28:23.648 INFO:teuthology.orchestra.run.smithi037.stdout:34359738372 2023-07-22T15:28:23.648 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-22T15:28:23.665 INFO:teuthology.orchestra.run.smithi037.stdout:34359738371 2023-07-22T15:28:23.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-22T15:28:23.694 INFO:teuthology.orchestra.run.smithi037.stdout:34359738374 2023-07-22T15:28:23.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-22T15:28:24.012 INFO:teuthology.orchestra.run.smithi037.stdout:34359738371 2023-07-22T15:28:24.027 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738371 for osd.1 2023-07-22T15:28:24.070 INFO:teuthology.orchestra.run.smithi037.stdout:34359738373 2023-07-22T15:28:24.081 INFO:teuthology.orchestra.run.smithi037.stdout:34359738370 2023-07-22T15:28:24.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2023-07-22T15:28:24.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.2 2023-07-22T15:28:25.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-22T15:28:25.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-22T15:28:25.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-22T15:28:25.390 INFO:teuthology.orchestra.run.smithi037.stdout:34359738372 2023-07-22T15:28:25.404 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738372 got 34359738372 for osd.1 2023-07-22T15:28:25.405 DEBUG:teuthology.parallel:result is None 2023-07-22T15:28:25.442 INFO:teuthology.orchestra.run.smithi037.stdout:34359738374 2023-07-22T15:28:25.457 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738374 for osd.0 2023-07-22T15:28:25.457 DEBUG:teuthology.parallel:result is None 2023-07-22T15:28:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:34359738371 2023-07-22T15:28:25.494 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.2 2023-07-22T15:28:25.494 DEBUG:teuthology.parallel:result is None 2023-07-22T15:28:25.494 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-22T15:28:25.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-22T15:28:25.864 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:28:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-22T15:28:25.877 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-07-22T15:28:25.239026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81312,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034208,"statfs":{"total":289910292480,"available":289827028992,"internally_reserved":0,"allocated":466944,"data_stored":1278171,"data_compressed":5718,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000637"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.352051+0000","last_change":"2023-07-22T15:28:22.349435+0000","last_active":"2023-07-22T15:28:23.352051+0000","last_peered":"2023-07-22T15:28:23.352051+0000","last_clean":"2023-07-22T15:28:23.352051+0000","last_became_active":"2023-07-22T15:28:22.348767+0000","last_became_peered":"2023-07-22T15:28:22.348767+0000","last_unstale":"2023-07-22T15:28:23.352051+0000","last_undegraded":"2023-07-22T15:28:23.352051+0000","last_fullsized":"2023-07-22T15:28:23.352051+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T22:43:49.066277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.352034+0000","last_change":"2023-07-22T15:28:22.349099+0000","last_active":"2023-07-22T15:28:23.352034+0000","last_peered":"2023-07-22T15:28:23.352034+0000","last_clean":"2023-07-22T15:28:23.352034+0000","last_became_active":"2023-07-22T15:28:22.348691+0000","last_became_peered":"2023-07-22T15:28:22.348691+0000","last_unstale":"2023-07-22T15:28:23.352034+0000","last_undegraded":"2023-07-22T15:28:23.352034+0000","last_fullsized":"2023-07-22T15:28:23.352034+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T23:14:04.985154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.352107+0000","last_change":"2023-07-22T15:28:22.352009+0000","last_active":"2023-07-22T15:28:23.352107+0000","last_peered":"2023-07-22T15:28:23.352107+0000","last_clean":"2023-07-22T15:28:23.352107+0000","last_became_active":"2023-07-22T15:28:22.351690+0000","last_became_peered":"2023-07-22T15:28:22.351690+0000","last_unstale":"2023-07-22T15:28:23.352107+0000","last_undegraded":"2023-07-22T15:28:23.352107+0000","last_fullsized":"2023-07-22T15:28:23.352107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T17:46:09.318300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-07-22T15:28:22.351797+0000","last_change":"2023-07-22T15:28:22.350284+0000","last_active":"2023-07-22T15:28:22.351797+0000","last_peered":"2023-07-22T15:28:22.351797+0000","last_clean":"2023-07-22T15:28:22.351797+0000","last_became_active":"2023-07-22T15:28:22.349943+0000","last_became_peered":"2023-07-22T15:28:22.349943+0000","last_unstale":"2023-07-22T15:28:22.351797+0000","last_undegraded":"2023-07-22T15:28:22.351797+0000","last_fullsized":"2023-07-22T15:28:22.351797+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T19:44:55.126082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'97","reported_seq":140,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-07-22T15:28:22.347307+0000","last_change":"2023-07-22T15:28:16.450627+0000","last_active":"2023-07-22T15:28:22.347307+0000","last_peered":"2023-07-22T15:28:22.347307+0000","last_clean":"2023-07-22T15:28:22.347307+0000","last_became_active":"2023-07-22T15:28:16.449394+0000","last_became_peered":"2023-07-22T15:28:16.449394+0000","last_unstale":"2023-07-22T15:28:22.347307+0000","last_undegraded":"2023-07-22T15:28:22.347307+0000","last_fullsized":"2023-07-22T15:28:22.347307+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:15.327598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:15.327598+0000","last_clean_scrub_stamp":"2023-07-22T15:28:15.327598+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T16:35:55.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.351921+0000","last_change":"2023-07-22T15:28:22.349237+0000","last_active":"2023-07-22T15:28:23.351921+0000","last_peered":"2023-07-22T15:28:23.351921+0000","last_clean":"2023-07-22T15:28:23.351921+0000","last_became_active":"2023-07-22T15:28:22.348805+0000","last_became_peered":"2023-07-22T15:28:22.348805+0000","last_unstale":"2023-07-22T15:28:23.351921+0000","last_undegraded":"2023-07-22T15:28:23.351921+0000","last_fullsized":"2023-07-22T15:28:23.351921+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T23:31:01.827155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-07-22T15:28:22.351412+0000","last_change":"2023-07-22T15:28:22.350368+0000","last_active":"2023-07-22T15:28:22.351412+0000","last_peered":"2023-07-22T15:28:22.351412+0000","last_clean":"2023-07-22T15:28:22.351412+0000","last_became_active":"2023-07-22T15:28:22.349971+0000","last_became_peered":"2023-07-22T15:28:22.349971+0000","last_unstale":"2023-07-22T15:28:22.351412+0000","last_undegraded":"2023-07-22T15:28:22.351412+0000","last_fullsized":"2023-07-22T15:28:22.351412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-24T02:15:09.676822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-07-22T15:28:22.356282+0000","last_change":"2023-07-22T15:28:22.351893+0000","last_active":"2023-07-22T15:28:22.356282+0000","last_peered":"2023-07-22T15:28:22.356282+0000","last_clean":"2023-07-22T15:28:22.356282+0000","last_became_active":"2023-07-22T15:28:22.351585+0000","last_became_peered":"2023-07-22T15:28:22.351585+0000","last_unstale":"2023-07-22T15:28:22.356282+0000","last_undegraded":"2023-07-22T15:28:22.356282+0000","last_fullsized":"2023-07-22T15:28:22.356282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-24T00:48:31.732775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.351955+0000","last_change":"2023-07-22T15:28:22.352117+0000","last_active":"2023-07-22T15:28:23.351955+0000","last_peered":"2023-07-22T15:28:23.351955+0000","last_clean":"2023-07-22T15:28:23.351955+0000","last_became_active":"2023-07-22T15:28:22.351772+0000","last_became_peered":"2023-07-22T15:28:22.351772+0000","last_unstale":"2023-07-22T15:28:23.351955+0000","last_undegraded":"2023-07-22T15:28:23.351955+0000","last_fullsized":"2023-07-22T15:28:23.351955+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T15:30:35.352981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":5718,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27064,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344776,"statfs":{"total":96636764160,"available":96609050624,"internally_reserved":0,"allocated":114688,"data_stored":31319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":621687,"data_compressed":2859,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":180224,"data_stored":625165,"data_compressed":2859,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":2859,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":2859,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-22T15:28:25.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-22T15:28:26.207 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:28:26.210 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-22T15:28:26.221 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-07-22T15:28:25.239026+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":81312,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":80832,"kb_avail":283034208,"statfs":{"total":289910292480,"available":289827028992,"internally_reserved":0,"allocated":466944,"data_stored":1278171,"data_compressed":5718,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":82771968},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000637"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.352051+0000","last_change":"2023-07-22T15:28:22.349435+0000","last_active":"2023-07-22T15:28:23.352051+0000","last_peered":"2023-07-22T15:28:23.352051+0000","last_clean":"2023-07-22T15:28:23.352051+0000","last_became_active":"2023-07-22T15:28:22.348767+0000","last_became_peered":"2023-07-22T15:28:22.348767+0000","last_unstale":"2023-07-22T15:28:23.352051+0000","last_undegraded":"2023-07-22T15:28:23.352051+0000","last_fullsized":"2023-07-22T15:28:23.352051+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T22:43:49.066277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.352034+0000","last_change":"2023-07-22T15:28:22.349099+0000","last_active":"2023-07-22T15:28:23.352034+0000","last_peered":"2023-07-22T15:28:23.352034+0000","last_clean":"2023-07-22T15:28:23.352034+0000","last_became_active":"2023-07-22T15:28:22.348691+0000","last_became_peered":"2023-07-22T15:28:22.348691+0000","last_unstale":"2023-07-22T15:28:23.352034+0000","last_undegraded":"2023-07-22T15:28:23.352034+0000","last_fullsized":"2023-07-22T15:28:23.352034+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T23:14:04.985154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.352107+0000","last_change":"2023-07-22T15:28:22.352009+0000","last_active":"2023-07-22T15:28:23.352107+0000","last_peered":"2023-07-22T15:28:23.352107+0000","last_clean":"2023-07-22T15:28:23.352107+0000","last_became_active":"2023-07-22T15:28:22.351690+0000","last_became_peered":"2023-07-22T15:28:22.351690+0000","last_unstale":"2023-07-22T15:28:23.352107+0000","last_undegraded":"2023-07-22T15:28:23.352107+0000","last_fullsized":"2023-07-22T15:28:23.352107+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T17:46:09.318300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-07-22T15:28:22.351797+0000","last_change":"2023-07-22T15:28:22.350284+0000","last_active":"2023-07-22T15:28:22.351797+0000","last_peered":"2023-07-22T15:28:22.351797+0000","last_clean":"2023-07-22T15:28:22.351797+0000","last_became_active":"2023-07-22T15:28:22.349943+0000","last_became_peered":"2023-07-22T15:28:22.349943+0000","last_unstale":"2023-07-22T15:28:22.351797+0000","last_undegraded":"2023-07-22T15:28:22.351797+0000","last_fullsized":"2023-07-22T15:28:22.351797+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T19:44:55.126082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'97","reported_seq":140,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-07-22T15:28:22.347307+0000","last_change":"2023-07-22T15:28:16.450627+0000","last_active":"2023-07-22T15:28:22.347307+0000","last_peered":"2023-07-22T15:28:22.347307+0000","last_clean":"2023-07-22T15:28:22.347307+0000","last_became_active":"2023-07-22T15:28:16.449394+0000","last_became_peered":"2023-07-22T15:28:16.449394+0000","last_unstale":"2023-07-22T15:28:22.347307+0000","last_undegraded":"2023-07-22T15:28:22.347307+0000","last_fullsized":"2023-07-22T15:28:22.347307+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:15.327598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:15.327598+0000","last_clean_scrub_stamp":"2023-07-22T15:28:15.327598+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T16:35:55.761460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.351921+0000","last_change":"2023-07-22T15:28:22.349237+0000","last_active":"2023-07-22T15:28:23.351921+0000","last_peered":"2023-07-22T15:28:23.351921+0000","last_clean":"2023-07-22T15:28:23.351921+0000","last_became_active":"2023-07-22T15:28:22.348805+0000","last_became_peered":"2023-07-22T15:28:22.348805+0000","last_unstale":"2023-07-22T15:28:23.351921+0000","last_undegraded":"2023-07-22T15:28:23.351921+0000","last_fullsized":"2023-07-22T15:28:23.351921+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T23:31:01.827155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-07-22T15:28:22.351412+0000","last_change":"2023-07-22T15:28:22.350368+0000","last_active":"2023-07-22T15:28:22.351412+0000","last_peered":"2023-07-22T15:28:22.351412+0000","last_clean":"2023-07-22T15:28:22.351412+0000","last_became_active":"2023-07-22T15:28:22.349971+0000","last_became_peered":"2023-07-22T15:28:22.349971+0000","last_unstale":"2023-07-22T15:28:22.351412+0000","last_undegraded":"2023-07-22T15:28:22.351412+0000","last_fullsized":"2023-07-22T15:28:22.351412+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-24T02:15:09.676822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2023-07-22T15:28:22.356282+0000","last_change":"2023-07-22T15:28:22.351893+0000","last_active":"2023-07-22T15:28:22.356282+0000","last_peered":"2023-07-22T15:28:22.356282+0000","last_clean":"2023-07-22T15:28:22.356282+0000","last_became_active":"2023-07-22T15:28:22.351585+0000","last_became_peered":"2023-07-22T15:28:22.351585+0000","last_unstale":"2023-07-22T15:28:22.356282+0000","last_undegraded":"2023-07-22T15:28:22.356282+0000","last_fullsized":"2023-07-22T15:28:22.356282+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-24T00:48:31.732775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-07-22T15:28:23.351955+0000","last_change":"2023-07-22T15:28:22.352117+0000","last_active":"2023-07-22T15:28:23.351955+0000","last_peered":"2023-07-22T15:28:23.351955+0000","last_clean":"2023-07-22T15:28:23.351955+0000","last_became_active":"2023-07-22T15:28:22.351772+0000","last_became_peered":"2023-07-22T15:28:22.351772+0000","last_unstale":"2023-07-22T15:28:23.351955+0000","last_undegraded":"2023-07-22T15:28:23.351955+0000","last_fullsized":"2023-07-22T15:28:23.351955+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-22T15:28:21.335844+0000","last_clean_scrub_stamp":"2023-07-22T15:28:21.335844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T15:30:35.352981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":5718,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27064,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344776,"statfs":{"total":96636764160,"available":96609050624,"internally_reserved":0,"allocated":114688,"data_stored":31319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27120,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344720,"statfs":{"total":96636764160,"available":96608993280,"internally_reserved":0,"allocated":172032,"data_stored":621687,"data_compressed":2859,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27128,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344712,"statfs":{"total":96636764160,"available":96608985088,"internally_reserved":0,"allocated":180224,"data_stored":625165,"data_compressed":2859,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":2859,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":2859,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-22T15:28:26.222 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-22T15:28:26.222 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-22T15:28:26.222 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-22T15:28:26.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-22T15:28:26.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-22T15:28:26.599 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-22T15:28:26.612 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-22T15:28:26.613 INFO:teuthology.run_tasks:Running task exec... 2023-07-22T15:28:26.626 INFO:teuthology.task.exec:Executing custom commands... 2023-07-22T15:28:26.627 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi037.front.sepia.ceph.com 2023-07-22T15:28:26.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-07-22T15:28:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cache' created 2023-07-22T15:28:27.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2023-07-22T15:28:28.362 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2023-07-22T15:28:28.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-07-22T15:28:29.364 INFO:teuthology.orchestra.run.smithi037.stderr:set cache-mode for pool 'cache' to writeback 2023-07-22T15:28:29.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2023-07-22T15:28:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:overlay for 'rbd' is now (or already was) 'cache' 2023-07-22T15:28:30.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-07-22T15:28:31.371 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 3 hit_set_type to bloom 2023-07-22T15:28:31.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-07-22T15:28:32.374 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 3 hit_set_count to 8 2023-07-22T15:28:32.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-07-22T15:28:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 3 hit_set_period to 60 2023-07-22T15:28:33.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-07-22T15:28:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 3 target_max_objects to 250 2023-07-22T15:28:34.395 INFO:teuthology.run_tasks:Running task workunit... 2023-07-22T15:28:34.409 INFO:tasks.workunit:Pulling workunits from ref 1bf364b918a7ab4708130a64bf96639942959f6d 2023-07-22T15:28:34.410 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-07-22T15:28:34.410 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2023-07-22T15:28:34.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-22T15:28:34.430 INFO:teuthology.orchestra.run.smithi037.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-07-22T15:28:34.431 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-07-22T15:28:34.490 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-07-22T15:28:34.491 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-07-22T15:28:34.550 INFO:tasks.workunit:timeout=3h 2023-07-22T15:28:34.551 INFO:tasks.workunit:cleanup=True 2023-07-22T15:28:34.551 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1bf364b918a7ab4708130a64bf96639942959f6d 2023-07-22T15:28:34.610 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-07-22T15:29:37.713 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to '1bf364b918a7ab4708130a64bf96639942959f6d'. 2023-07-22T15:29:37.714 INFO:tasks.workunit.client.0.smithi037.stderr: 2023-07-22T15:29:37.714 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-07-22T15:29:37.714 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2023-07-22T15:29:37.714 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2023-07-22T15:29:37.714 INFO:tasks.workunit.client.0.smithi037.stderr: 2023-07-22T15:29:37.715 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2023-07-22T15:29:37.715 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2023-07-22T15:29:37.715 INFO:tasks.workunit.client.0.smithi037.stderr: 2023-07-22T15:29:37.715 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2023-07-22T15:29:37.715 INFO:tasks.workunit.client.0.smithi037.stderr: 2023-07-22T15:29:37.715 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2023-07-22T15:29:37.715 INFO:tasks.workunit.client.0.smithi037.stderr: 2023-07-22T15:29:37.715 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2023-07-22T15:29:37.716 INFO:tasks.workunit.client.0.smithi037.stderr: 2023-07-22T15:29:37.716 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-07-22T15:29:37.716 INFO:tasks.workunit.client.0.smithi037.stderr: 2023-07-22T15:29:37.716 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at 1bf364b918a Merge branch 'wip-62106-reef' of https://github.com/cbodley/ceph into wip-yuri10-testing-2023-07-21-0828-reef 2023-07-22T15:29:37.717 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-07-22T15:29:37.783 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-07-22T15:29:37.786 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-22T15:29:37.786 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-07-22T15:29:38.312 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-07-22T15:29:38.366 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-07-22T15:29:38.405 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-07-22T15:29:38.407 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-22T15:29:38.407 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-07-22T15:29:38.445 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-07-22T15:29:38.448 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-22T15:29:38.449 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-07-22T15:29:38.506 INFO:tasks.workunit:Running workunits matching rbd/cli_migration.sh on client.0... 2023-07-22T15:29:38.507 INFO:tasks.workunit:Running workunit rbd/cli_migration.sh... 2023-07-22T15:29:38.507 DEBUG:teuthology.orchestra.run.smithi037:workunit test rbd/cli_migration.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1bf364b918a7ab4708130a64bf96639942959f6d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_migration.sh 2023-07-22T15:29:38.567 INFO:tasks.workunit.client.0.smithi037.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_migration.sh 2023-07-22T15:29:38.568 INFO:tasks.workunit.client.0.smithi037.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2023-07-22T15:29:38.568 INFO:tasks.workunit.client.0.smithi037.stderr:++ TIMEOUT=300 2023-07-22T15:29:38.569 INFO:tasks.workunit.client.0.smithi037.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-07-22T15:29:38.569 INFO:tasks.workunit.client.0.smithi037.stderr:++ MAX_TIMEOUT=15 2023-07-22T15:29:38.569 INFO:tasks.workunit.client.0.smithi037.stderr:++ PG_NUM=4 2023-07-22T15:29:38.569 INFO:tasks.workunit.client.0.smithi037.stderr:++ TMPDIR=/tmp 2023-07-22T15:29:38.569 INFO:tasks.workunit.client.0.smithi037.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-07-22T15:29:38.569 INFO:tasks.workunit.client.0.smithi037.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-07-22T15:29:38.569 INFO:tasks.workunit.client.0.smithi037.stderr:++ type xmlstarlet 2023-07-22T15:29:38.569 INFO:tasks.workunit.client.0.smithi037.stderr:++ XMLSTARLET=xmlstarlet 2023-07-22T15:29:38.570 INFO:tasks.workunit.client.0.smithi037.stderr:+++ uname 2023-07-22T15:29:38.570 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' Linux = FreeBSD ']' 2023-07-22T15:29:38.570 INFO:tasks.workunit.client.0.smithi037.stderr:++ SED=sed 2023-07-22T15:29:38.571 INFO:tasks.workunit.client.0.smithi037.stderr:++ AWK=awk 2023-07-22T15:29:38.571 INFO:tasks.workunit.client.0.smithi037.stderr:+++ stty -a 2023-07-22T15:29:38.571 INFO:tasks.workunit.client.0.smithi037.stderr:+++ head -1 2023-07-22T15:29:38.571 INFO:tasks.workunit.client.0.smithi037.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-07-22T15:29:38.580 INFO:tasks.workunit.client.0.smithi037.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-07-22T15:29:38.581 INFO:tasks.workunit.client.0.smithi037.stderr:++ termwidth= 2023-07-22T15:29:38.581 INFO:tasks.workunit.client.0.smithi037.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-07-22T15:29:38.581 INFO:tasks.workunit.client.0.smithi037.stderr:++ DIFFCOLOPTS='-y ' 2023-07-22T15:29:38.581 INFO:tasks.workunit.client.0.smithi037.stderr:++ KERNCORE=kernel.core_pattern 2023-07-22T15:29:38.581 INFO:tasks.workunit.client.0.smithi037.stderr:++ EXTRA_OPTS= 2023-07-22T15:29:38.586 INFO:tasks.workunit.client.0.smithi037.stderr:++ test '' = TESTS 2023-07-22T15:29:38.586 INFO:tasks.workunit.client.0.smithi037.stderr:+ TEMPDIR= 2023-07-22T15:29:38.586 INFO:tasks.workunit.client.0.smithi037.stderr:+ IMAGE1=image1 2023-07-22T15:29:38.587 INFO:tasks.workunit.client.0.smithi037.stderr:+ IMAGE2=image2 2023-07-22T15:29:38.587 INFO:tasks.workunit.client.0.smithi037.stderr:+ IMAGE3=image3 2023-07-22T15:29:38.587 INFO:tasks.workunit.client.0.smithi037.stderr:+ IMAGES='image1 image2 image3' 2023-07-22T15:29:38.587 INFO:tasks.workunit.client.0.smithi037.stderr:+ rbd ls 2023-07-22T15:29:38.588 INFO:tasks.workunit.client.0.smithi037.stderr:+ wc -l 2023-07-22T15:29:38.588 INFO:tasks.workunit.client.0.smithi037.stderr:+ grep -v '^0$' 2023-07-22T15:29:38.634 INFO:tasks.workunit.client.0.smithi037.stderr:+ setup_tempdir 2023-07-22T15:29:38.635 INFO:tasks.workunit.client.0.smithi037.stderr:++ mktemp -d 2023-07-22T15:29:38.636 INFO:tasks.workunit.client.0.smithi037.stderr:+ TEMPDIR=/tmp/tmp.xEH2Ti4y83 2023-07-22T15:29:38.636 INFO:tasks.workunit.client.0.smithi037.stderr:+ trap 'cleanup $?' INT TERM EXIT 2023-07-22T15:29:38.636 INFO:tasks.workunit.client.0.smithi037.stderr:+ create_base_image image1 2023-07-22T15:29:38.636 INFO:tasks.workunit.client.0.smithi037.stderr:+ local image=image1 2023-07-22T15:29:38.636 INFO:tasks.workunit.client.0.smithi037.stderr:+ rbd create --size 1G image1 2023-07-22T15:29:40.447 INFO:tasks.workunit.client.0.smithi037.stderr:+ rbd bench --io-type write --io-pattern rand --io-size=4K --io-total 256M image1 2023-07-22T15:29:40.496 INFO:tasks.workunit.client.0.smithi037.stdout:bench type write io_size 4096 io_threads 16 bytes 268435456 pattern random 2023-07-22T15:29:40.512 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:40.513+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac03be80 msgr2=0x7f81ac03e2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T15:29:41.128 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:41.129+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x55ddecea32f0 msgr2=0x7f81ac079d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:29:41.364 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:41.363+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac03be80 msgr2=0x7f81ac03e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T15:29:41.527 INFO:tasks.workunit.client.0.smithi037.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-07-22T15:29:41.527 INFO:tasks.workunit.client.0.smithi037.stdout: 1 4080 3980.62 16 MiB/s 2023-07-22T15:29:41.597 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:41.597+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81a8004bb0 msgr2=0x7f81a8006f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:29:41.867 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:41.867+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x55ddecea32f0 msgr2=0x7f81ac0d3d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:29:42.318 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:42.318+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x55ddecea32f0 msgr2=0x7f81ac0d3c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T15:29:42.476 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:42.477+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac03be80 msgr2=0x7f81ac0b3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:29:42.751 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:42.752+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x55ddecea32f0 msgr2=0x7f81ac0d3c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T15:29:42.844 INFO:tasks.workunit.client.0.smithi037.stdout: 2 7264 3101.87 12 MiB/s 2023-07-22T15:29:43.300 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:43.299+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac03be80 msgr2=0x7f81ac040e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T15:29:43.347 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:43.347+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x55ddecea32f0 msgr2=0x7f81ac0d3c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:29:43.356 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:43.356+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81a8004bb0 msgr2=0x7f81ac0408e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T15:29:43.649 INFO:tasks.workunit.client.0.smithi037.stdout: 3 9760 3101.56 12 MiB/s 2023-07-22T15:29:43.663 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:43.663+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x55ddecea32f0 msgr2=0x7f81ac0d3c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T15:29:43.822 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:43.821+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81a8004bb0 msgr2=0x7f81ac0408e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:29:43.902 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:29:43.902+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x55ddecea32f0 msgr2=0x7f81ac03e260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:30:14.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:14.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:15.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:15.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:15.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:15.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:16.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:16.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:16.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:16.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:17.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:17.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:17.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:17.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:18.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:18.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:18.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:18.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:19.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:19.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:19.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:19.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:19.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:19.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:20.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:20.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:20.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:20.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:21.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:21.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:21.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:21.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:22.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:22.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:22.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:22.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:23.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:23.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:23.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:23.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:24.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:24.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:24.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:24.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:25.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:25.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:26.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:26.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:26.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:26.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:27.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:27.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:27.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:27.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:28.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:28.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:28.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:28.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:29.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:29.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:29.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:29.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:29.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:29.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:30.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:30.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:30.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:30.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:31.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:31.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:31.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:31.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:32.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:32.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:33.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:33.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:33.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:33.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:34.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:34.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:34.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:34.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:35.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:35.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:35.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:35.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:36.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:36.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:36.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:36.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:37.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:37.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:37.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:37.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:38.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:38.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:38.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:38.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:39.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:39.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:39.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:39.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:40.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:40.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:40.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:40.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:41.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:41.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:41.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:41.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:42.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:42.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:42.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:42.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:43.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:43.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:43.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:43.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:44.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:44.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:44.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:44.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:45.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:45.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:45.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:45.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:46.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:46.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:46.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:46.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:47.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:47.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:47.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:47.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:47.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:47.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:48.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:48.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:49.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:49.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:49.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:49.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:50.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:50.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:50.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:50.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:51.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:51.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:51.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:51.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:52.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:52.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:52.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:52.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:53.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:53.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:53.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:53.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:54.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:54.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:54.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:54.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:54.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:54.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:55.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:55.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:55.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:55.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:56.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:56.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:57.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:57.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:57.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:57.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:57.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:57.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:58.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:58.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:59.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:59.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:59.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:30:59.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:30:59.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:30:59.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:00.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:00.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:00.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:00.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:01.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:01.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:01.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:01.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:02.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:02.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:02.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:02.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:03.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:03.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:04.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:04.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:04.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:04.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:05.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:05.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:05.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:05.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:06.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:06.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:06.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:06.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:07.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:07.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:07.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:07.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:08.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:08.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:08.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:08.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:09.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:09.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:09.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:09.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:10.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:10.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:10.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:10.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:11.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:11.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:11.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:11.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:12.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:12.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:12.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:12.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:13.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:13.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:13.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:13.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:14.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:14.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:14.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:14.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:15.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:15.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:15.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:15.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:16.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:16.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:16.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:16.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:17.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:17.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:17.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:17.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:18.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:18.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:18.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:18.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:19.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:19.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:19.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:19.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:20.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:20.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:20.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:20.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:21.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:21.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:21.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:21.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:22.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:22.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:22.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:22.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:23.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:23.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:23.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:23.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:24.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:24.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:24.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:24.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:25.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:25.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:25.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:25.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:26.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:26.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:26.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:26.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:27.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:27.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:27.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:27.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:28.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:28.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:28.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:28.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:29.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:29.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:29.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:29.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:30.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:30.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:30.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:30.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:31.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:31.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:31.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:31.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:32.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:32.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:32.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:32.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:33.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:33.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:33.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:33.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:34.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:34.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:34.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:34.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:35.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:35.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:35.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:35.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:36.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:36.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:36.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:36.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:37.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:37.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:37.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:37.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:38.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:38.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:38.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:38.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:39.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:39.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:39.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:39.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:40.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:40.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:40.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:40.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:41.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:41.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:41.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:41.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:42.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:42.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:42.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:42.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:43.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:43.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:43.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:43.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:44.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:44.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:44.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:44.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:45.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:45.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:45.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:45.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:46.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:46.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:46.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:46.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:47.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:47.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:47.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:47.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:48.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:48.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:48.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:48.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:49.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:49.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:49.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:49.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:50.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:50.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:50.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:50.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:51.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:51.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:51.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:51.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:52.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:52.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:52.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:52.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:53.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:53.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:53.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:53.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:54.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:54.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:54.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:54.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:55.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:55.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:55.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:55.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:56.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:56.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:56.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:56.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:57.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:57.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:57.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:57.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:58.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:58.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:58.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:58.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:59.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:31:59.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:31:59.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:31:59.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:00.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:00.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:00.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:00.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:01.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:01.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:01.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:01.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:02.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:02.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:02.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:02.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:03.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:03.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:03.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:03.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:04.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:04.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:04.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:04.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:05.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:05.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:05.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:05.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:06.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:06.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:06.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:06.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:07.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:07.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:07.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:07.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:08.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:08.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:08.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:08.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:09.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:09.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:09.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:09.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:10.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:10.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:10.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:10.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:11.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:11.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:11.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:11.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:12.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:12.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:12.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:12.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:13.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:13.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:13.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:13.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:14.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:14.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:14.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:14.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:15.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:15.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:15.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:15.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:16.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:16.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:16.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:16.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:17.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:17.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:17.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:17.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:18.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:18.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:18.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:18.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:19.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:19.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:19.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:19.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:20.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:20.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:20.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:20.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:21.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:21.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:21.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:21.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:22.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:22.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:22.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:22.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:23.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:23.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:23.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:23.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:24.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:24.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:24.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:24.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:25.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:25.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:25.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:25.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:26.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:26.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:26.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:26.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:27.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:27.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:27.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:27.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:28.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:28.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:28.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:28.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:29.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:29.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:29.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:29.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:30.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:30.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:30.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:30.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:31.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:31.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:31.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:31.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:32.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:32.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:32.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:32.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:33.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:33.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:33.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:33.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:34.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:34.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:34.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:34.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:35.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:35.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:35.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:35.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:36.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:36.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:36.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:36.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:37.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:37.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:37.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:37.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:38.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:38.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:38.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:38.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:39.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:39.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:39.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:39.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:40.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:40.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:40.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:40.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:41.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:41.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:41.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:41.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:42.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:42.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:42.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:42.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:43.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:43.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:43.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:43.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:44.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:44.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:44.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:44.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:45.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:45.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:45.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:45.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:46.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:46.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:46.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:46.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:47.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:47.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:47.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:47.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:48.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:48.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:48.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:48.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:49.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:49.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:49.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:49.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:50.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:50.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:50.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:50.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:51.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:51.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:51.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:51.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:52.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:52.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:52.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:52.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:53.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:53.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:53.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:53.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:54.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:54.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:54.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:54.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:55.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:55.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:55.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:55.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:56.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:56.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:56.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:56.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:57.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:57.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:57.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:57.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:58.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:58.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:58.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:58.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:59.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:32:59.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:32:59.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:32:59.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:00.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:00.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:00.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:00.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:01.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:01.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:01.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:01.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:02.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:02.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:02.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:02.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:03.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:03.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:03.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:03.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:04.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:04.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:04.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:04.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:05.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:05.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:05.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:05.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:06.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:06.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:06.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:06.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:07.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:07.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:07.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:07.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:08.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:08.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:08.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:08.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:09.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:09.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:09.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:09.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:10.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:10.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:10.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:10.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:11.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:11.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:11.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:11.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:12.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:12.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:12.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:12.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:13.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:13.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:13.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:13.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:14.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:14.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:14.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:14.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:15.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:15.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:15.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:15.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:16.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:16.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:16.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:16.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:17.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:17.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:17.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:17.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:18.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:18.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:18.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:18.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:19.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:19.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:19.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:19.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:20.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:20.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:20.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:20.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:21.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:21.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:21.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:21.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:22.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:22.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:22.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:22.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:22.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:22.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:23.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:23.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:24.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:24.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:24.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:24.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:25.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:25.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:25.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:25.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:25.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:25.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:26.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:26.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:26.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:26.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:27.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:27.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:28.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:28.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:28.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:28.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:28.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:28.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:29.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:29.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:30.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:30.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:30.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:30.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:31.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:31.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:31.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:31.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:32.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:32.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:32.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:32.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:33.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:33.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:33.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:33.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:34.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:34.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:34.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:34.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:35.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:35.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:35.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:35.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:36.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:36.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:36.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:36.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:37.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:37.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:37.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:37.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:38.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:38.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:38.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:38.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:38.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:38.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:39.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:39.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:39.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:39.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:40.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:40.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:40.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:40.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:41.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:41.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:41.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:41.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:42.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:42.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:42.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:42.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:43.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:43.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:43.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:43.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:44.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:44.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:44.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:44.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:45.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:45.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:45.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:45.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:46.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:46.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:46.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:46.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:47.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:47.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:47.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:47.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:48.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:48.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:48.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:48.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:49.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:49.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:49.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:49.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:50.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:50.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:50.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:50.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:51.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:51.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:51.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:51.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:52.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:52.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:53.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:53.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:53.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:53.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:53.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:53.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:54.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:54.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:55.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:55.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:55.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:55.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:55.534 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:33:55.534+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac03be80 msgr2=0x7f81ac040e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:33:56.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:56.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:56.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:56.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:57.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:57.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:57.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:57.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:58.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:58.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:58.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:58.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:59.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:33:59.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:33:59.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:33:59.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:00.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:00.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:00.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:00.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:00.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:00.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:01.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:01.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:01.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:01.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:02.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:02.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:03.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:03.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:03.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:03.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:03.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:03.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:04.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:04.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:04.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:04.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:05.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:05.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:05.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:05.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:06.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:06.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:07.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:07.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:07.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:07.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:08.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:08.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:08.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:08.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:09.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:09.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:09.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:09.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:10.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:10.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:10.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:10.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:10.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:10.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:11.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:11.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:12.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:12.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:12.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:12.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:13.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:13.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:13.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:13.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:14.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:14.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:14.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:14.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:15.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:15.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:15.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:15.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:16.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:16.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:16.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:16.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:17.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:17.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:17.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:17.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:18.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:18.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:18.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:18.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:19.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:19.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:19.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:19.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:20.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:20.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:20.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:20.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:21.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:21.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:21.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:21.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:22.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:22.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:22.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:22.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:23.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:23.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:23.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:23.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:23.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:23.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:24.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:24.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:24.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:24.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:25.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:25.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:25.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:25.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:26.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:26.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:27.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:27.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:27.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:27.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:27.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:27.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:28.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:28.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:28.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:28.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:29.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:29.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:29.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:29.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:30.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:30.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:30.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:30.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:31.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:31.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:31.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:31.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:32.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:32.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:32.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:32.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:33.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:33.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:33.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:33.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:34.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:34.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:34.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:34.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:35.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:35.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:35.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:35.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:36.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:36.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:36.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:36.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:37.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:37.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:37.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:37.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:38.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:38.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:38.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:38.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:39.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:39.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:39.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:39.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:40.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:40.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:40.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:40.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:41.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:41.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:41.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:41.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:42.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:42.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:42.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:42.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:43.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:43.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:43.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:43.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:44.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:44.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:44.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:44.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:45.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:45.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:46.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:46.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:46.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:46.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:47.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:47.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:47.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:47.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:48.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:48.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:48.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:48.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:49.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:49.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:49.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:49.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:50.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:50.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:50.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:50.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:51.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:51.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:51.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:51.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:52.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:52.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:52.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:52.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:53.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:53.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:53.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:53.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:54.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:54.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:54.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:54.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:55.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:55.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:55.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:55.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:56.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:56.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:56.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:56.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:57.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:57.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:57.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:57.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:58.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:58.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:58.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:58.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:59.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:34:59.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:34:59.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:34:59.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:00.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:00.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:00.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:00.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:00.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:00.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:01.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:01.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:01.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:01.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:02.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:02.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:02.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:02.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:03.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:03.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:03.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:03.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:04.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:04.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:04.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:04.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:05.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:05.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:05.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:05.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:06.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:06.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:06.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:06.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:07.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:07.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:07.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:07.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:08.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:08.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:08.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:08.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:08.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:08.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:09.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:09.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:10.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:10.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:10.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:10.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:11.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:11.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:11.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:11.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:11.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:11.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:12.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:12.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:13.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:13.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:13.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:13.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:13.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:13.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:14.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:14.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:15.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:15.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:15.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:15.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:15.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:15.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:16.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:16.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:16.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:16.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:17.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:17.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:17.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:17.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:18.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:18.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:18.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:18.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:19.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:19.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:19.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:19.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:20.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:20.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:20.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:20.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:21.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:21.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:21.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:21.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:22.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:22.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:22.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:22.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:23.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:23.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:23.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:23.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:24.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:24.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:24.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:24.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:25.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:25.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:25.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:25.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:26.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:26.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:26.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:26.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:27.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:27.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:27.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:27.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:28.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:28.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:28.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:29.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:29.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:29.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:29.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:29.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:31.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:31.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:31.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:31.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:32.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:32.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:32.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:32.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:33.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:33.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:33.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:33.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:34.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:34.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:34.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:34.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:35.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:35.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:35.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:35.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:36.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:36.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:36.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:36.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:37.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:37.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:37.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:37.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:38.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:38.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:38.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:38.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:39.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:39.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:39.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:39.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:40.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:40.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:40.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:40.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:41.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:41.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:41.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:41.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:42.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:42.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:42.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:42.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:43.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:43.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:43.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:43.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:44.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:44.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:44.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:44.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:44.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:44.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:45.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:45.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:46.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:46.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:46.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:46.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:47.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:47.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:47.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:47.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:47.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:47.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:48.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:48.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:48.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:48.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:49.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:49.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:49.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:49.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:50.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:50.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:50.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:50.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:51.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:51.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:51.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:51.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:52.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:52.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:52.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:52.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:53.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:53.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:53.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:53.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:54.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:54.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:54.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:54.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:55.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:55.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:55.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:55.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:56.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:56.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:57.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:57.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:57.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:57.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:58.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:58.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:58.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:58.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:59.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:35:59.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:35:59.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:35:59.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:00.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:00.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:00.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:00.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:01.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:01.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:01.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:01.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:02.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:02.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:02.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:02.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:03.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:03.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:03.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:03.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:04.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:04.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:04.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:04.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:05.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:05.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:05.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:05.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:06.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:06.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:06.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:06.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:07.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:07.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:07.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:07.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:08.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:08.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:08.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:08.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:09.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:09.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:09.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:09.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:10.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:10.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:10.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:10.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:11.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:11.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:11.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:11.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:12.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:12.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:12.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:12.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:13.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:13.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:13.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:13.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:14.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:14.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:14.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:14.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:15.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:15.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:15.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:15.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:16.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:16.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:16.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:16.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:17.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:17.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:17.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:17.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:18.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:18.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:18.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:18.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:19.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:19.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:19.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:19.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:20.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:20.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:20.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:20.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:21.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:21.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:21.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:21.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:22.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:22.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:22.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:22.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:23.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:23.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:23.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:23.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:24.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:24.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:24.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:24.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:25.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:25.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:25.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:25.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:26.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:26.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:26.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:26.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:27.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:27.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:27.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:27.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:28.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:28.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:28.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:28.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:29.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:29.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:29.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:29.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:30.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:30.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:30.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:30.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:31.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:31.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:31.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:31.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:32.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:32.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:32.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:32.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:33.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:33.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:33.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:33.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:34.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:34.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:34.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:34.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:35.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:35.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:35.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:35.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:36.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:36.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:36.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:36.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:37.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:37.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:37.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:37.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:38.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:38.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:38.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:38.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:39.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:39.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:39.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:39.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:40.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:40.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:40.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:40.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:41.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:41.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:41.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:41.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:42.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:42.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:42.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:42.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:43.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:43.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:43.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:43.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:44.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:44.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:44.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:44.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:45.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:45.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:45.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:45.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:46.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:46.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:46.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:46.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:47.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:47.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:47.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:47.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:48.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:48.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:48.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:48.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:49.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:49.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:49.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:49.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:50.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:50.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:50.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:50.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:51.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:51.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:51.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:51.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:52.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:52.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:52.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:52.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:53.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:53.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:53.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:53.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:54.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:54.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:54.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:54.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:55.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:55.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:55.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:55.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:56.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:56.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:56.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:56.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:57.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:57.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:57.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:57.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:58.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:58.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:58.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:58.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:59.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:36:59.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:36:59.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:36:59.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:00.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:00.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:00.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:00.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:01.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:01.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:01.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:01.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:02.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:02.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:02.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:02.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:03.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:03.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:03.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:03.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:04.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:04.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:04.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:04.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:05.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:05.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:05.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:05.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:06.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:06.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:06.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:06.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:07.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:07.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:07.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:07.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:08.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:08.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:08.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:08.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:09.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:09.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:09.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:09.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:10.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:10.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:10.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:10.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:11.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:11.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:11.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:11.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:12.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:12.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:12.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:12.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:13.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:13.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:13.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:13.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:14.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:14.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:14.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:14.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:15.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:15.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:15.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:15.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:16.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:16.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:16.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:16.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:17.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:17.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:17.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:17.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:18.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:18.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:18.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:18.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:19.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:19.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:19.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:19.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:20.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:20.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:20.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:20.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:21.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:21.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:21.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:21.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:22.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:22.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:22.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:22.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:23.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:23.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:23.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:23.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:24.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:24.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:24.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:24.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:25.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:25.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:25.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:25.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:26.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:26.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:26.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:26.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:27.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:27.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:27.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:27.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:28.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:28.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:28.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:28.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:29.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:29.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:29.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:29.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:30.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:30.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:30.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:30.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:31.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:31.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:31.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:31.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:32.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:32.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:32.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:32.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:33.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:33.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:33.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:33.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:34.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:34.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:34.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:34.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:35.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:35.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:35.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:35.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:36.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:36.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:36.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:36.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:37.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:37.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:37.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:37.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:38.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:38.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:38.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:38.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:39.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:39.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:39.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:39.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:40.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:40.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:40.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:40.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:41.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:41.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:41.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:41.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:42.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:42.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:42.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:42.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:43.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:43.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:43.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:43.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:44.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:44.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:44.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:44.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:45.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:45.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:45.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:45.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:46.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:46.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:46.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:46.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:47.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:47.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:47.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:47.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:48.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:48.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:48.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:48.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:49.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:49.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:49.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:49.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:50.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:50.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:50.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:50.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:51.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:51.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:51.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:51.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:52.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:52.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:52.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:52.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:53.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:53.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:53.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:53.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:54.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:54.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:54.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:54.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:55.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:55.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:55.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:55.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:56.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:56.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:56.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:56.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:57.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:57.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:57.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:57.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:58.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:58.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:58.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:58.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:59.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:37:59.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:37:59.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:37:59.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:00.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:00.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:00.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:00.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:01.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:01.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:01.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:01.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:02.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:02.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:02.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:02.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:03.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:03.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:03.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:03.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:04.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:04.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:04.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:04.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:05.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:05.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:05.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:05.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:06.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:06.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:06.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:06.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:07.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:07.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:07.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:07.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:08.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:08.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:08.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:08.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:09.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:09.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:09.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:09.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:10.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:10.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:10.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:10.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:11.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:11.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:11.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:11.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:12.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:12.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:12.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:12.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:13.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:13.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:13.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:13.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:14.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:14.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:14.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:14.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:15.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:15.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:15.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:15.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:16.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:16.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:16.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:16.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:17.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:17.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:17.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:17.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:18.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:18.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:18.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:18.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:19.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:19.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:19.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:19.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:20.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:20.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:20.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:20.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:21.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:21.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:21.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:21.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:22.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:22.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:22.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:22.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:23.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:23.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:23.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:23.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:24.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:24.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:24.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:24.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:25.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:25.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:25.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:25.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:26.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:26.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:26.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:26.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:27.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:27.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:27.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:27.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:28.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:28.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:28.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:28.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:29.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:29.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:29.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:29.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:30.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:30.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:30.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:30.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:31.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:31.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:31.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:31.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:32.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:32.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:32.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:32.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:33.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:33.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:33.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:33.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:34.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:34.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:34.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:34.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:35.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:35.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:35.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:35.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:36.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:36.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:36.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:36.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:37.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:37.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:37.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:37.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:38.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:38.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:38.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:38.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:39.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:39.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:39.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:39.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:40.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:40.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:40.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:40.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:41.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:41.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:41.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:41.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:42.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:42.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:42.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:42.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:43.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:43.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:43.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:43.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:44.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:44.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:44.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:44.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:45.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:45.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:45.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:45.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:46.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:46.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:46.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:46.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:47.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:47.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:47.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:47.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:48.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:48.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:48.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:48.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:49.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:49.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:49.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:49.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:50.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:50.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:50.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:50.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:51.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:51.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:51.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:51.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:52.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:52.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:52.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:52.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:53.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:53.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:53.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:53.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:54.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:54.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:54.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:54.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:55.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:55.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:55.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:55.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:56.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:56.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:56.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:56.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:57.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:57.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:57.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:57.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:58.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:58.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:58.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:58.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:59.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:38:59.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:38:59.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:38:59.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:00.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:00.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:00.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:00.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:01.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:01.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:01.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:01.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:02.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:02.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:02.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:02.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:03.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:03.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:03.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:03.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:04.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:04.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:04.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:04.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:05.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:05.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:05.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:05.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:06.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:06.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:06.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:06.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:07.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:07.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:07.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:07.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:08.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:08.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:08.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:08.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:09.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:09.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:09.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:09.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:10.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:10.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:10.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:10.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:11.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:11.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:11.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:11.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:12.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:12.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:12.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:12.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:13.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:13.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:13.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:13.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:14.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:14.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:14.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:14.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:15.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:15.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:15.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:15.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:16.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:16.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:16.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:16.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:17.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:17.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:17.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:17.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:18.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:18.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:18.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:18.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:19.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:19.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:19.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:19.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:20.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:20.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:20.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:20.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:21.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:21.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:21.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:21.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:22.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:22.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:22.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:22.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:23.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:23.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:23.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:23.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:24.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:24.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:24.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:24.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:25.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:25.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:25.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:25.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:26.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:26.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:26.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:26.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:27.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:27.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:27.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:27.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:28.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:28.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:28.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:28.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:29.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:29.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:29.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:29.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:30.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:30.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:30.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:30.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:31.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:31.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:31.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:31.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:32.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:32.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:32.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:32.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:33.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:33.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:33.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:33.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:34.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:34.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:34.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:34.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:35.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:35.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:35.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:35.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:36.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:36.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:36.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:36.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:37.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:37.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:37.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:37.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:38.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:38.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:38.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:38.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:39.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:39.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:39.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:39.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:40.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:40.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:40.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:40.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:41.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:41.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:41.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:41.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:42.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:42.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:42.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:42.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:43.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:43.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:43.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:43.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:44.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:44.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:44.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:44.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:45.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:45.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:45.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:45.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:46.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:46.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:46.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:46.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:47.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:47.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:47.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:47.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:48.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:48.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:48.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:48.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:49.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:49.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:49.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:49.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:50.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:50.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:50.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:50.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:51.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:51.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:51.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:51.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:52.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:52.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:52.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:52.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:53.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:53.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:53.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:53.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:54.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:54.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:54.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:54.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:55.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:55.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:55.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:55.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:56.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:56.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:56.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:56.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:57.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:57.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:57.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:57.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:58.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:58.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:58.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:58.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:59.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:39:59.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:39:59.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:39:59.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:00.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:00.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:00.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:00.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:01.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:01.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:01.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:01.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:02.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:02.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:02.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:02.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:03.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:03.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:03.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:03.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:04.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:04.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:04.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:04.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:05.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:05.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:05.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:05.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:06.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:06.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:07.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:07.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:07.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:07.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:08.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:08.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:08.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:08.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:09.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:09.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:09.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:09.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:10.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:10.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:10.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:10.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:11.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:11.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:11.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:11.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:12.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:12.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:12.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:12.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:13.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:13.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:13.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:13.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:14.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:14.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:14.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:14.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:15.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:15.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:15.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:15.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:16.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:16.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:16.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:16.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:17.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:17.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:17.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:17.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:18.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:18.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:18.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:18.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:19.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:19.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:19.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:19.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:20.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:20.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:20.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:20.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:21.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:21.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:21.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:21.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:22.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:22.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:22.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:22.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:23.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:23.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:23.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:23.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:24.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:24.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:24.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:24.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:25.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:25.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:25.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:25.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:26.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:26.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:26.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:26.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:27.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:27.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:27.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:27.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:28.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:28.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:29.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:29.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:30.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:30.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:31.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:31.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:32.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:32.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:33.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:33.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:34.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:34.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:35.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:35.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:36.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:36.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:37.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:37.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:38.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:38.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:39.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:39.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:40.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:40.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:41.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:41.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:42.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:42.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:43.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:43.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:44.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:44.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:45.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:45.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:46.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:46.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:47.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:47.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:48.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:48.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:49.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:49.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:50.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:50.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:51.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:51.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:52.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:52.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:53.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:53.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:54.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:54.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:55.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:55.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:56.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:56.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:57.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:57.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:58.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:58.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:58.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:58.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:59.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:40:59.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:40:59.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:40:59.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:00.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:00.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:00.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:00.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:01.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:01.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:01.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:01.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:02.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:02.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:02.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:02.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:03.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:03.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:03.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:03.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:04.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:04.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:04.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:04.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:05.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:05.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:05.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:05.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:05.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:05.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:06.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:06.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:06.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:06.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:07.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:07.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:07.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:07.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:08.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:08.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:08.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:08.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:09.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:09.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:09.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:09.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:10.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:10.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:10.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:10.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:11.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:11.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:11.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:11.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:12.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:12.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:12.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:12.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:13.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:13.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:13.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:13.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:14.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:14.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:14.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:14.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:15.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:15.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:15.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:15.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:16.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:16.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:16.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:16.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:17.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:17.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:17.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:17.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:18.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:18.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:18.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:18.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:19.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:19.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:19.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:19.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:20.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:20.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:20.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:20.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:21.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:21.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:21.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:21.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:22.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:22.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:22.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:22.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:23.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:23.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:23.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:23.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:24.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:24.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:25.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:25.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:25.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:25.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:26.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:26.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:26.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:26.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:27.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:27.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:27.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:27.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:28.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:28.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:28.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:28.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:29.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:29.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:29.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:29.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:30.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:30.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:30.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:30.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:31.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:31.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:31.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:31.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:32.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:32.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:32.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:32.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:33.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:33.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:33.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:33.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:34.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:34.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:34.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:34.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:35.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:35.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:35.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:35.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:36.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:36.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:36.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:36.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:37.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:37.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:37.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:37.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:38.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:38.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:38.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:38.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:39.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:39.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:39.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:39.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:40.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:40.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:40.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:40.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:41.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:41.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:41.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:41.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:42.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:42.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:42.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:42.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:43.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:43.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:43.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:43.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:44.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:44.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:44.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:44.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:45.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:45.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:45.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:45.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:46.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:46.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:46.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:46.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:47.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:47.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:47.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:47.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:48.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:48.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:48.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:48.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:49.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:49.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:49.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:49.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:50.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:50.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:50.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:50.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:51.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:51.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:51.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:51.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:52.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:52.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:52.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:52.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:53.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:53.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:53.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:53.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:54.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:54.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:54.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:54.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:55.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:55.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:55.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:55.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:56.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:56.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:56.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:56.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:57.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:57.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:57.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:57.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:58.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:58.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:58.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:58.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:59.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:41:59.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:41:59.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:41:59.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:00.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:00.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:00.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:00.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:01.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:01.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:01.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:01.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:02.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:02.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:02.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:02.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:03.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:03.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:03.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:03.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:04.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:04.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:04.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:04.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:05.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:05.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:05.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:05.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:06.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:06.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:06.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:06.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:07.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:07.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:07.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:07.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:08.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:08.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:08.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:08.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:09.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:09.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:09.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:09.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:10.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:10.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:10.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:10.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:11.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:11.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:11.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:11.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:12.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:12.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:12.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:12.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:13.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:13.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:13.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:13.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:14.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:14.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:14.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:14.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:15.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:15.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:15.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:15.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:16.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:16.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:16.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:16.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:17.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:17.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:17.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:17.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:18.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:18.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:18.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:18.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:19.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:19.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:19.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:19.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:20.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:20.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:20.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:20.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:21.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:21.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:21.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:21.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:22.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:22.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:22.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:22.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:23.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:23.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:23.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:23.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:24.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:24.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:24.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:24.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:25.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:25.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:25.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:25.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:26.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:26.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:26.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:26.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:26.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:26.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:27.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:27.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:27.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:27.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:28.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:28.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:29.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:29.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:29.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:29.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:30.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:30.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:30.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:30.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:30.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:30.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:31.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:31.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:32.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:32.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:32.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:32.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:33.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:33.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:33.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:33.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:33.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:33.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:34.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:34.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:34.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:34.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:35.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:35.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:36.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:36.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:36.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:36.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:37.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:37.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:37.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:37.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:38.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:38.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:38.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:38.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:39.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:39.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:39.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:39.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:40.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:40.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:40.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:40.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:41.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:41.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:41.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:41.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:42.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:42.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:42.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:42.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:43.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:43.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:43.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:43.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:44.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:44.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:44.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:44.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:45.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:45.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:45.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:45.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:46.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:46.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:46.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:46.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:47.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:47.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:47.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:47.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:48.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:48.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:48.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:48.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:49.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:49.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:49.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:49.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:50.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:50.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:50.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:50.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:51.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:51.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:51.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:51.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:52.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:52.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:52.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:52.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:53.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:53.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:53.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:53.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:54.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:54.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:54.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:54.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:55.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:55.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:55.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:55.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:56.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:56.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:56.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:56.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:57.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:57.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:57.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:57.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:58.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:58.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:58.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:58.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:59.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:42:59.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:42:59.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:42:59.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:00.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:00.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:00.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:00.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:01.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:01.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:01.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:01.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:02.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:02.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:02.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:02.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:03.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:03.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:03.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:03.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:03.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:03.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:04.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:04.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:04.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:04.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:05.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:05.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:05.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:05.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:06.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:06.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:06.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:06.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:07.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:07.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:07.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:07.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:08.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:08.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:08.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:08.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:09.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:09.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:09.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:09.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:09.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:09.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:10.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:10.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:11.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:11.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:11.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:11.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:12.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:12.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:12.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:12.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:13.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:13.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:13.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:13.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:14.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:14.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:14.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:14.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:15.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:15.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:15.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:15.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:16.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:16.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:16.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:16.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:17.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:17.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:17.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:17.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:18.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:18.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:18.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:18.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:19.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:19.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:19.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:19.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:20.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:20.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:20.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:20.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:21.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:21.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:21.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:21.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:22.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:22.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:22.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:22.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:23.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:23.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:23.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:23.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:24.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:24.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:24.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:24.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:25.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:25.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:25.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:25.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:26.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:26.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:26.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:26.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:27.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:27.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:27.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:27.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:28.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:28.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:28.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:28.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:29.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:29.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:29.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:29.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:30.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:30.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:30.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:30.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:31.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:31.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:31.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:31.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:32.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:32.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:32.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:32.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:33.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:33.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:33.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:33.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:34.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:34.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:35.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:35.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:35.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:35.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:36.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:36.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:36.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:36.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:37.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:37.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:37.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:37.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:38.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:38.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:38.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:38.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:39.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:39.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:39.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:39.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:40.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:40.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:40.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:40.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:41.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:41.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:41.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:41.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:42.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:42.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:42.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:42.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:43.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:43.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:43.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:43.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:44.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:44.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:44.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:44.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:45.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:45.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:45.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:45.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:46.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:46.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:46.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:46.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:47.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:47.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:47.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:47.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:48.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:48.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:48.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:48.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:49.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:49.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:49.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:49.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:50.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:50.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:50.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:50.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:51.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:51.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:51.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:51.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:52.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:52.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:52.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:52.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:53.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:53.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:53.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:53.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:54.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:54.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:54.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:54.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:55.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:55.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:55.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:55.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:56.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:56.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:56.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:56.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:57.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:57.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:57.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:57.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:58.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:58.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:58.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:58.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:58.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:58.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:59.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:43:59.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:43:59.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:43:59.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:00.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:00.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:01.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:01.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:01.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:01.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:01.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:01.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:02.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:02.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:03.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:03.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:03.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:03.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:04.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:04.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:04.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:04.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:04.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:04.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:05.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:05.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:05.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:05.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:06.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:06.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:07.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:07.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:07.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:07.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:08.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:08.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:08.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:08.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:09.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:09.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:09.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:09.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:09.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:09.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:10.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:10.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:10.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:10.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:11.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:11.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:11.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:11.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:12.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:12.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:12.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:12.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:13.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:13.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:13.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:13.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:14.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:14.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:15.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:15.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:15.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:15.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:16.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:16.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:16.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:16.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:17.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:17.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:17.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:17.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:18.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:18.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:18.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:18.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:19.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:19.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:19.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:19.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:20.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:20.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:20.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:20.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:21.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:21.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:21.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:21.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:22.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:22.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:22.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:22.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:23.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:23.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:23.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:23.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:24.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:24.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:24.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:24.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:25.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:25.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:25.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:25.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:26.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:26.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:26.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:26.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:27.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:27.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:27.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:27.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:28.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:28.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:28.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:28.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:29.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:29.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:29.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:29.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:30.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:30.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:30.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:30.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:31.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:31.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:31.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:31.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:32.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:32.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:32.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:32.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:33.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:33.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:33.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:33.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:34.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:34.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:34.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:34.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:35.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:35.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:35.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:35.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:36.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:36.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:36.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:36.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:37.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:37.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:37.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:37.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:38.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:38.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:38.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:38.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:39.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:39.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:39.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:39.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:40.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:40.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:40.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:40.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:41.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:41.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:41.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:41.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:42.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:42.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:42.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:42.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:43.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:43.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:43.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:43.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:44.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:44.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:44.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:44.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:45.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:45.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:45.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:45.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:46.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:46.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:46.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:46.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:47.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:47.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:47.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:47.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:48.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:48.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:48.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:48.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:49.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:49.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:49.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:49.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:50.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:50.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:50.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:50.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:51.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:51.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:51.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:51.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:52.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:52.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:52.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:52.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:53.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:53.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:53.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:53.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:54.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:54.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:54.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:54.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:55.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:55.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:55.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:55.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:56.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:56.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:56.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:56.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:57.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:57.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:57.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:57.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:58.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:58.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:58.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:58.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:59.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:44:59.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:44:59.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:44:59.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:00.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:00.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:00.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:00.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:01.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:01.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:01.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:01.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:02.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:02.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:02.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:02.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:03.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:03.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:03.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:03.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:04.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:04.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:04.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:04.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:05.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:05.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:05.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:05.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:06.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:06.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:06.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:06.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:07.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:07.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:07.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:07.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:08.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:08.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:08.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:08.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:09.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:09.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:09.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:09.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:10.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:10.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:10.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:10.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:11.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:11.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:11.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:11.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:12.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:12.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:12.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:12.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:13.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:13.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:13.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:13.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:14.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:14.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:14.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:14.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:15.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:15.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:15.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:15.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:16.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:16.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:16.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:16.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:17.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:17.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:17.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:17.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:18.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:18.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:18.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:18.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:19.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:19.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:19.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:19.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:20.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:20.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:20.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:20.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:21.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:21.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:21.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:21.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:22.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:22.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:22.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:22.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:23.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:23.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:23.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:23.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:24.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:24.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:24.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:24.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:25.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:25.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:25.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:25.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:26.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:26.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:26.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:26.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:27.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:27.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:27.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:27.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:28.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:28.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:28.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:28.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:29.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:29.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:29.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:29.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:30.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:30.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:30.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:30.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:31.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:31.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:31.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:31.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:32.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:32.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:32.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:32.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:33.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:33.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:33.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:33.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:34.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:34.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:34.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:34.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:35.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:35.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:35.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:35.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:36.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:36.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:36.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:36.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:37.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:37.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:37.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:37.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:38.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:38.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:38.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:38.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:39.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:39.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:39.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:39.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:40.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:40.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:40.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:40.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:41.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:41.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:41.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:41.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:42.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:42.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:42.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:42.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:43.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:43.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:43.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:43.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:44.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:44.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:44.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:44.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:45.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:45.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:45.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:45.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:46.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:46.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:46.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:46.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:47.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:47.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:47.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:47.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:48.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:48.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:48.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:48.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:49.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:49.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:49.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:49.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:50.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:50.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:50.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:50.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:51.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:51.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:51.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:51.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:52.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:52.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:52.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:52.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:53.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:53.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:53.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:53.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:54.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:54.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:54.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:54.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:55.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:55.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:55.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:55.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:56.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:56.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:56.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:56.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:57.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:57.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:57.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:57.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:58.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:58.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:58.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:58.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:59.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:45:59.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:45:59.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:45:59.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:00.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:00.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:00.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:00.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:01.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:01.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:01.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:01.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:02.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:02.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:02.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:02.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:03.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:03.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:03.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:03.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:04.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:04.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:04.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:04.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:05.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:05.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:05.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:05.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:06.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:06.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:06.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:06.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:07.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:07.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:07.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:07.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:08.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:08.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:08.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:08.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:09.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:09.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:09.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:09.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:10.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:10.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:10.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:10.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:11.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:11.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:11.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:11.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:12.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:12.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:12.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:12.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:13.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:13.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:13.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:13.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:14.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:14.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:14.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:14.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:15.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:15.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:15.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:15.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:16.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:16.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:16.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:16.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:17.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:17.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:17.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:17.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:18.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:18.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:18.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:18.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:19.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:19.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:19.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:19.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:20.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:20.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:20.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:20.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:21.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:21.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:21.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:21.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:22.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:22.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:22.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:22.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:23.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:23.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:23.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:23.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:24.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:24.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:24.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:24.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:25.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:25.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:25.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:25.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:26.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:26.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:26.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:26.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:27.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:27.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:27.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:27.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:28.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:28.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:28.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:28.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:29.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:29.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:29.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:29.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:30.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:30.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:30.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:30.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:31.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:31.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:31.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:31.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:32.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:32.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:32.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:32.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:33.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:33.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:33.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:33.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:34.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:34.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:34.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:34.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:35.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:35.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:35.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:35.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:36.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:36.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:36.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:36.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:37.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:37.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:37.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:37.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:38.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:38.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:38.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:38.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:39.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:39.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:39.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:39.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:40.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:40.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:40.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:40.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:41.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:41.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:41.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:41.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:42.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:42.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:42.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:42.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:43.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:43.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:43.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:43.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:44.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:44.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:44.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:44.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:45.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:45.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:45.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:45.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:46.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:46.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:46.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:46.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:47.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:47.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:47.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:47.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:48.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:48.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:48.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:48.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:49.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:49.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:49.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:49.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:50.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:50.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:50.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:50.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:51.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:51.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:51.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:51.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:52.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:52.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:52.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:52.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:53.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:53.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:53.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:53.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:54.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:54.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:54.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:54.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:55.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:55.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:55.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:55.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:56.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:56.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:56.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:56.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:57.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:57.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:57.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:57.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:58.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:58.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:58.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:58.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:59.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:46:59.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:46:59.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:46:59.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:00.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:00.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:00.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:00.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:01.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:01.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:01.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:01.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:02.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:02.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:02.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:02.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:03.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:03.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:03.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:03.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:04.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:04.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:04.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:04.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:05.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:05.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:05.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:05.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:06.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:06.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:06.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:06.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:07.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:07.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:07.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:07.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:08.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:08.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:08.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:08.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:09.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:09.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:09.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:09.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:10.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:10.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:10.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:10.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:11.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:11.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:11.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:11.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:12.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:12.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:12.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:12.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:13.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:13.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:13.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:13.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:14.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:14.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:14.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:14.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:15.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:15.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:15.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:15.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:16.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:16.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:16.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:16.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:17.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:17.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:17.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:17.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:18.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:18.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:18.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:18.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:19.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:19.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:19.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:19.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:20.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:20.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:20.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:20.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:21.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:21.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:21.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:21.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:22.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:22.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:22.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:22.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:23.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:23.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:23.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:23.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:24.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:24.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:24.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:24.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:25.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:25.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:25.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:25.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:26.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:26.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:26.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:26.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:27.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:27.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:27.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:27.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:28.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:28.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:28.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:28.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:29.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:29.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:29.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:29.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:30.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:30.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:30.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:30.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:31.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:31.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:31.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:31.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:32.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:32.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:32.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:32.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:33.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:33.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:33.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:33.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:34.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:34.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:34.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:34.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:35.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:35.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:35.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:35.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:36.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:36.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:36.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:36.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:37.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:37.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:37.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:37.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:38.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:38.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:38.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:38.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:39.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:39.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:39.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:39.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:40.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:40.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:40.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:40.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:41.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:41.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:41.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:41.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:42.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:42.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:42.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:42.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:43.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:43.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:43.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:43.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:44.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:44.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:44.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:44.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:45.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:45.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:45.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:45.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:46.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:46.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:46.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:46.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:47.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:47.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:47.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:47.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:48.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:48.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:48.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:48.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:49.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:49.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:49.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:49.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:50.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:50.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:50.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:50.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:51.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:51.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:51.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:51.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:52.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:52.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:52.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:52.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:53.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:53.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:53.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:53.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:54.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:54.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:54.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:54.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:55.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:55.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:55.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:55.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:56.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:56.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:56.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:56.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:57.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:57.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:57.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:57.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:58.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:58.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:58.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:58.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:59.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:47:59.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:47:59.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:47:59.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:00.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:00.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:00.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:00.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:01.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:01.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:01.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:01.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:02.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:02.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:02.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:02.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:03.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:03.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:03.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:03.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:04.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:04.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:04.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:04.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:05.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:05.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:05.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:05.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:06.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:06.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:06.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:06.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:07.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:07.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:07.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:07.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:08.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:08.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:08.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:08.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:09.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:09.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:09.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:09.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:10.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:10.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:10.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:10.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:11.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:11.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:11.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:11.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:12.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:12.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:12.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:12.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:13.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:13.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:13.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:13.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:14.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:14.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:14.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:14.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:15.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:15.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:15.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:15.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:16.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:16.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:16.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:16.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:17.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:17.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:17.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:17.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:18.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:18.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:18.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:18.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:19.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:19.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:19.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:19.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:20.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:20.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:20.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:20.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:21.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:21.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:21.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:21.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:22.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:22.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:22.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:22.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:23.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:23.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:23.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:23.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:24.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:24.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:24.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:24.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:25.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:25.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:25.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:25.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:26.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:26.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:26.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:26.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:27.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:27.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:27.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:27.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:28.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:28.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:28.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:28.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:29.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:29.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:29.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:29.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:30.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:30.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:30.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:30.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:31.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:31.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:31.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:31.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:32.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:32.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:32.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:32.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:33.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:33.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:33.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:33.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:34.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:34.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:34.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:34.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:35.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:35.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:35.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:35.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:36.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:36.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:36.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:36.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:37.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:37.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:37.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:37.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:38.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:38.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:38.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:38.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:39.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:39.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:39.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:39.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:40.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:40.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:40.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:40.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:41.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:41.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:41.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:41.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:42.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:42.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:42.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:42.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:43.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:43.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:43.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:43.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:44.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:44.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:44.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:44.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:45.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:45.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:45.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:45.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:46.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:46.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:46.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:46.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:47.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:47.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:47.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:47.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:48.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:48.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:48.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:48.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:49.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:49.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:49.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:49.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:50.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:50.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:50.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:50.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:51.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:51.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:51.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:51.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:52.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:52.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:52.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:52.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:53.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:53.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:53.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:53.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:54.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:54.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:54.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:54.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:55.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:55.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:55.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:55.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:56.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:56.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:56.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:56.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:57.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:57.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:57.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:57.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:58.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:58.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:58.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:58.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:59.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:48:59.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:48:59.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:48:59.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:00.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:00.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:00.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:00.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:01.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:01.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:01.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:01.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:02.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:02.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:02.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:02.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:03.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:03.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:03.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:03.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:04.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:04.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:04.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:04.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:05.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:05.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:05.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:05.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:06.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:06.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:06.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:06.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:07.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:07.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:07.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:07.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:08.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:08.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:08.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:08.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:09.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:09.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:09.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:09.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:10.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:10.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:10.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:10.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:11.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:11.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:11.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:11.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:12.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:12.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:12.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:12.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:13.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:13.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:13.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:13.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:14.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:14.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:14.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:14.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:15.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:15.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:15.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:15.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:16.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:16.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:16.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:16.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:17.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:17.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:17.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:17.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:18.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:18.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:18.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:18.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:19.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:19.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:19.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:19.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:20.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:20.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:20.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:20.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:21.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:21.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:21.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:21.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:22.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:22.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:22.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:22.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:23.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:23.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:23.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:23.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:24.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:24.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:24.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:24.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:25.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:25.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:25.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:25.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:26.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:26.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:26.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:26.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:27.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:27.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:27.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:27.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:28.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:28.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:28.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:28.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:29.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:29.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:29.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:29.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:30.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:30.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:30.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:30.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:31.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:31.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:31.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:31.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:32.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:32.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:32.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:32.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:33.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:33.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:33.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:33.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:34.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:34.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:34.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:34.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:35.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:35.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:35.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:35.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:36.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:36.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:36.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:36.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:37.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:37.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:37.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:37.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:38.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:38.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:38.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:38.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:39.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:39.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:39.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:39.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:40.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:40.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:40.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:40.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:41.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:41.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:41.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:41.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:42.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:42.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:42.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:42.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:43.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:43.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:43.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:43.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:44.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:44.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:44.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:44.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:45.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:45.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:45.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:45.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:46.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:46.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:46.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:46.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:46.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:46.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:47.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:47.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:48.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:48.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:48.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:48.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:49.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:49.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:49.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:49.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:50.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:50.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:50.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:50.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:51.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:50.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:51.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:51.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:51.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:51.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:52.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:52.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:52.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:52.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:53.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:53.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:54.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:54.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:54.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:54.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:54.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:54.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:55.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:55.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:55.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:55.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:56.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:56.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:56.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:56.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:57.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:57.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:57.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:57.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:58.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:58.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:58.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:58.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:59.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:49:59.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:49:59.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:49:59.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:00.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:00.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:01.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:00.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:01.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:01.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:02.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:02.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:02.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:02.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:03.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:03.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:03.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:03.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:04.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:04.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:04.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:04.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:04.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:04.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:05.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:05.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:05.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:05.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:06.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:06.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:06.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:06.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:07.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:07.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:07.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:07.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:08.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:08.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:09.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:09.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:09.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:09.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:09.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:09.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:10.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:10.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:11.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:11.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:11.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:11.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:12.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:12.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:12.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:12.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:13.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:13.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:13.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:13.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:13.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:13.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:14.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:14.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:14.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:14.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:15.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:15.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:15.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:15.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:16.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:16.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:16.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:16.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:17.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:17.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:17.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:17.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:18.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:18.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:18.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:18.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:19.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:19.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:19.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:19.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:20.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:20.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:20.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:20.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:21.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:21.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:21.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:21.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:22.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:22.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:22.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:22.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:23.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:23.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:23.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:23.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:24.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:24.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:24.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:24.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:25.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:25.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:25.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:25.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:26.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:26.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:26.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:26.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:27.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:27.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:27.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:27.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:28.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:28.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:28.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:28.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:29.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:29.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:29.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:29.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:30.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:30.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:30.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:30.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:31.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:31.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:31.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:31.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:32.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:32.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:32.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:32.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:33.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:33.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:33.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:33.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:34.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:34.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:34.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:34.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:35.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:35.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:35.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:35.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:36.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:36.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:36.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:36.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:37.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:37.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:37.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:37.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:38.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:38.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:38.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:38.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:39.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:39.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:39.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:39.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:40.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:40.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:40.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:40.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:41.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:41.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:41.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:41.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:42.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:42.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:42.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:42.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:43.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:43.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:43.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:43.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:44.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:44.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:44.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:44.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:45.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:45.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:45.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:45.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:46.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:46.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:46.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:46.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:47.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:47.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:47.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:47.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:48.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:48.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:48.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:48.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:49.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:49.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:49.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:49.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:50.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:50.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:50.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:50.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:51.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:51.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:51.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:51.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:52.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:52.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:52.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:52.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:53.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:53.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:53.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:53.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:54.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:54.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:54.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:54.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:55.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:55.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:55.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:55.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:56.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:56.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:56.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:56.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:57.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:57.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:57.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:57.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:58.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:58.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:58.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:58.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:59.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:50:59.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:50:59.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:50:59.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:00.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:00.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:00.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:00.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:01.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:01.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:01.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:01.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:02.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:02.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:02.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:02.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:03.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:03.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:03.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:03.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:04.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:04.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:04.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:04.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:05.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:05.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:05.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:05.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:06.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:06.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:06.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:06.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:07.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:07.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:07.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:07.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:08.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:08.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:08.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:08.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:09.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:09.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:09.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:09.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:10.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:10.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:10.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:10.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:11.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:11.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:11.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:11.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:12.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:12.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:12.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:12.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:13.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:13.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:13.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:13.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:14.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:14.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:14.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:14.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:15.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:15.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:15.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:15.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:16.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:16.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:16.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:16.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:17.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:17.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:17.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:17.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:18.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:18.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:18.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:18.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:19.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:19.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:19.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:19.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:20.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:20.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:20.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:20.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:21.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:21.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:21.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:21.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:22.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:22.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:22.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:22.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:23.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:23.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:23.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:23.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:24.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:24.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:24.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:24.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:25.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:25.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:25.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:25.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:26.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:26.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:26.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:26.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:27.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:27.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:27.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:27.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:28.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:28.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:28.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:28.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:29.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:29.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:29.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:29.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:30.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:30.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:30.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:30.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:31.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:31.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:31.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:31.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:32.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:32.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:32.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:32.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:33.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:33.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:33.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:33.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:34.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:34.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:34.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:34.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:35.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:35.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:35.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:35.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:36.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:36.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:36.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:36.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:37.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:37.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:37.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:37.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:38.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:38.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:38.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:38.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:39.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:39.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:39.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:39.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:40.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:40.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:40.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:40.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:41.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:41.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:41.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:41.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:42.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:42.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:42.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:42.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:43.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:43.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:43.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:43.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:44.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:44.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:44.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:44.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:45.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:45.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:45.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:45.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:46.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:46.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:46.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:46.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:47.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:47.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:47.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:47.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:48.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:48.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:48.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:48.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:49.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:49.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:49.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:49.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:50.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:50.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:50.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:50.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:51.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:51.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:51.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:51.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:52.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:52.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:52.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:52.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:53.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:53.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:53.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:53.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:54.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:54.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:54.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:54.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:55.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:55.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:55.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:55.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:56.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:56.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:56.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:56.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:57.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:57.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:57.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:57.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:58.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:58.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:58.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:58.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:59.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:51:59.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:51:59.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:51:59.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:00.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:00.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:00.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:00.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:01.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:01.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:01.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:01.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:02.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:02.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:02.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:02.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:03.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:03.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:03.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:03.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:04.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:04.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:04.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:04.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:05.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:05.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:05.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:05.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:06.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:06.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:06.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:06.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:07.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:07.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:07.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:07.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:08.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:08.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:08.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:08.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:09.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:09.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:09.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:09.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:10.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:10.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:10.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:10.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:11.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:11.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:11.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:11.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:12.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:12.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:12.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:12.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:13.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:13.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:13.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:13.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:14.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:14.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:14.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:14.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:15.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:15.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:15.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:15.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:16.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:16.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:16.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:16.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:17.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:17.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:17.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:17.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:18.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:18.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:18.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:18.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:19.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:19.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:19.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:19.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:20.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:20.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:20.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:20.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:21.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:21.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:21.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:21.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:22.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:22.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:22.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:22.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:23.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:23.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:23.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:23.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:24.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:24.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:24.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:24.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:25.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:25.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:25.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:25.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:26.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:26.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:26.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:26.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:27.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:27.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:27.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:27.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:28.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:28.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:28.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:28.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:29.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:29.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:29.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:29.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:30.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:30.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:30.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:30.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:31.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:31.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:31.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:31.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:32.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:32.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:32.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:32.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:33.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:33.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:33.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:33.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:34.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:34.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:34.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:34.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:35.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:35.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:35.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:35.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:36.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:36.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:36.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:36.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:37.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:37.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:37.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:37.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:38.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:38.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:38.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:38.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:39.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:39.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:39.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:39.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:40.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:40.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:40.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:40.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:41.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:41.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:41.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:41.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:42.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:42.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:42.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:42.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:43.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:43.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:43.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:43.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:44.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:44.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:44.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:44.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:45.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:45.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:45.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:45.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:46.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:46.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:46.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:46.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:47.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:47.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:47.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:47.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:48.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:48.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:48.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:48.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:49.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:49.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:49.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:49.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:50.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:50.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:50.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:50.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:51.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:51.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:51.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:51.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:52.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:52.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:52.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:52.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:53.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:53.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:53.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:53.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:54.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:54.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:54.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:54.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:55.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:55.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:55.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:55.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:56.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:56.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:56.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:56.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:57.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:57.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:57.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:57.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:58.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:58.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:58.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:58.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:59.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:52:59.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:52:59.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:52:59.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:00.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:00.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:00.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:00.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:01.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:01.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:01.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:01.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:02.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:02.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:02.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:02.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:03.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:03.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:03.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:03.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:04.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:04.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:04.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:04.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:05.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:05.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:05.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:05.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:06.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:06.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:06.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:06.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:07.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:07.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:07.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:07.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:08.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:08.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:08.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:08.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:09.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:09.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:09.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:09.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:10.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:10.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:10.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:10.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:11.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:11.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:11.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:11.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:12.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:12.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:12.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:12.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:13.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:13.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:13.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:13.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:14.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:14.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:14.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:14.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:15.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:15.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:15.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:15.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:16.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:16.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:16.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:16.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:17.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:17.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:17.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:17.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:18.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:18.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:18.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:18.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:19.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:19.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:19.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:19.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:20.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:20.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:20.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:20.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:21.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:21.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:21.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:21.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:22.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:22.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:22.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:22.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:23.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:23.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:23.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:23.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:24.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:24.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:24.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:24.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:25.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:25.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:25.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:25.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:26.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:26.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:26.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:26.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:27.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:27.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:27.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:27.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:28.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:28.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:28.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:28.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:29.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:29.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:29.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:29.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:30.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:30.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:30.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:30.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:31.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:31.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:31.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:31.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:32.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:32.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:32.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:32.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:33.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:33.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:33.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:33.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:34.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:34.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:34.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:34.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:35.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:35.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:35.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:35.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:36.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:36.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:36.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:36.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:37.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:37.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:37.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:37.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:38.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:38.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:38.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:38.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:39.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:39.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:39.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:39.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:40.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:40.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:40.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:40.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:41.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:41.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:41.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:41.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:42.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:42.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:42.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:42.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:43.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:43.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:43.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:43.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:44.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:44.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:44.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:44.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:45.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:45.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:45.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:45.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:46.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:46.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:46.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:46.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:47.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:47.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:47.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:47.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:48.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:48.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:48.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:48.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:49.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:49.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:49.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:49.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:50.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:50.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:50.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:50.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:51.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:51.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:51.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:51.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:52.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:52.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:52.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:52.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:53.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:53.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:53.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:53.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:54.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:54.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:54.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:54.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:55.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:55.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:55.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:55.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:56.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:56.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:56.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:56.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:57.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:57.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:57.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:57.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:58.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:58.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:58.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:58.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:59.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:53:59.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:53:59.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:53:59.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:00.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:00.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:00.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:00.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:01.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:01.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:01.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:01.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:02.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:02.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:02.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:02.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:03.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:03.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:03.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:03.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:04.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:04.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:04.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:04.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:05.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:05.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:05.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:05.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:06.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:06.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:06.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:06.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:07.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:07.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:07.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:07.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:08.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:08.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:08.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:08.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:09.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:09.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:09.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:09.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:10.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:10.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:10.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:10.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:11.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:11.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:11.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:11.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:12.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:12.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:12.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:12.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:13.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:13.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:13.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:13.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:14.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:14.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:14.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:14.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:15.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:15.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:15.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:15.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:16.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:16.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:16.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:16.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:17.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:17.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:17.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:17.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:18.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:18.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:18.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:18.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:19.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:19.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:19.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:19.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:20.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:20.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:20.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:20.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:21.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:21.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:21.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:21.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:22.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:22.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:22.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:22.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:23.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:23.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:23.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:23.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:24.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:24.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:24.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:24.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:25.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:25.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:25.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:25.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:26.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:26.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:27.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:27.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:27.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:27.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:27.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:27.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:28.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:28.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:28.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:28.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:29.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:29.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:29.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:29.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:30.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:30.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:30.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:30.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:31.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:31.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:31.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:31.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:32.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:32.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:32.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:32.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:33.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:33.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:33.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:33.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:34.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:34.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:34.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:34.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:35.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:35.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:35.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:35.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:36.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:36.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:36.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:36.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:37.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:37.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:37.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:37.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:38.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:38.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:38.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:38.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:39.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:39.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:39.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:39.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:40.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:40.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:40.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:40.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:41.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:41.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:41.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:41.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:42.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:42.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:42.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:42.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:43.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:43.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:43.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:43.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:44.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:44.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:44.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:44.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:45.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:45.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:45.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:45.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:46.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:46.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:46.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:46.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:47.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:47.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:47.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:47.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:48.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:48.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:48.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:48.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:49.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:49.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:49.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:49.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:50.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:50.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:50.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:50.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:51.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:51.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:51.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:51.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:52.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:52.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:52.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:52.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:53.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:53.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:53.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:53.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:54.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:54.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:54.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:54.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:55.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:55.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:55.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:55.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:56.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:56.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:56.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:56.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:57.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:57.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:57.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:57.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:58.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:58.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:58.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:58.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:59.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:54:59.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:54:59.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:54:59.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:00.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:00.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:00.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:00.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:01.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:01.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:01.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:01.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:02.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:02.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:02.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:02.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:03.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:03.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:03.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:03.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:04.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:04.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:04.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:04.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:05.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:05.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:05.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:05.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:06.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:06.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:06.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:06.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:07.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:07.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:07.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:07.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:08.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:08.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:08.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:08.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:09.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:09.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:09.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:09.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:10.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:10.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:10.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:10.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:11.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:11.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:11.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:11.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:12.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:12.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:12.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:12.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:13.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:13.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:13.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:13.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:14.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:14.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:14.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:14.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:15.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:15.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:15.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:15.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:16.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:16.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:16.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:16.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:17.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:17.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:17.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:17.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:18.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:18.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:18.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:18.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:19.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:19.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:19.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:19.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:20.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:20.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:20.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:20.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:21.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:21.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:21.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:21.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:22.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:22.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:22.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:22.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:23.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:23.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:23.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:23.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:24.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:24.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:24.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:24.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:25.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:25.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:25.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:25.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:26.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:26.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 6 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:26.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:26.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:27.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:27.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:27.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:27.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:28.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:28.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:28.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:28.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:29.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:29.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:29.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:29.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:30.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:30.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:30.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:30.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:31.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:31.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:31.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:31.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:32.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:32.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:32.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:32.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:33.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:33.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:33.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:33.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:34.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:34.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:34.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:34.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:35.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:35.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:35.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:35.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:36.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:36.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:36.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:36.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:37.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:37.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:37.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:37.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:38.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:38.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:38.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:38.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:39.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:39.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:39.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:39.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:40.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:40.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:40.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:40.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:41.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:41.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:41.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:41.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:42.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:42.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:42.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:42.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:43.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:43.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:43.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:43.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:44.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:44.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:44.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:44.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:45.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:45.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:45.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:45.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:46.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:46.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:46.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:46.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:47.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:47.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:47.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:47.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:48.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:48.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:48.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:48.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:49.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:49.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:49.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:49.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:50.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:50.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:50.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:50.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:51.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:51.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:51.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:51.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:52.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:52.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:52.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:52.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:53.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:53.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:53.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:53.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:54.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:54.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:54.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:54.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:55.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:55.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:55.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:55.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:56.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:56.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T15:55:56.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:56.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:57.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:57.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:57.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:57.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:58.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:58.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:58.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:58.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:59.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:55:59.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:55:59.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:55:59.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:00.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:00.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:00.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:00.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:01.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:01.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:01.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:01.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:02.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:02.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:02.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:02.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:03.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:03.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:03.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:03.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:04.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:04.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:04.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:04.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:05.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:05.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:05.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:05.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:06.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:06.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:06.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:06.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:07.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:07.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:07.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:07.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:08.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:08.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:08.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:08.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:09.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:09.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:09.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:09.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:10.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:10.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:10.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:10.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:11.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:11.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:11.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:11.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:12.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:12.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:12.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:12.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:13.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:13.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:13.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:13.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:14.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:14.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:14.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:14.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:15.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:15.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:15.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:15.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:16.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:16.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:16.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:16.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:17.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:17.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:17.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:17.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:18.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:18.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:18.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:18.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:19.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:19.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:19.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:19.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:20.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:20.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:20.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:20.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:21.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:21.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:21.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:21.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:22.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:22.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:22.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:22.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:23.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:23.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:23.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:23.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:24.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:24.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:24.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:24.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:25.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:25.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:25.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:25.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:26.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:26.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:26.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:26.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:27.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:27.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:27.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:27.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:28.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:28.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:28.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:28.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:29.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:29.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:29.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:29.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:30.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:30.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:30.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:30.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:31.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:31.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:31.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:31.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:32.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:32.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:32.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:32.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:33.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:33.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:33.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:33.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:34.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:34.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:34.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:34.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:35.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:35.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:35.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:35.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:36.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:36.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:37.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:36.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:37.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:37.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:37.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:37.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:38.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:38.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:39.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:39.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:39.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:39.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:39.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:39.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:40.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:40.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:41.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:41.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:41.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:41.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:42.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:42.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:42.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:42.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:43.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:43.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:43.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:43.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:44.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:44.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:44.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:44.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:45.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:45.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:45.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:45.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:45.794 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T15:56:45.791+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac03be80 msgr2=0x7f81ac040e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T15:56:46.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:46.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:46.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:46.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:47.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:47.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:47.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:47.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:48.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:48.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:48.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:48.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:49.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:49.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:49.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:49.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:50.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:50.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:50.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:50.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:51.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:51.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:51.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:51.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:52.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:52.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:52.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:52.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:53.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:53.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:53.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:53.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:54.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:54.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:54.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:54.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:55.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:55.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:55.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:55.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:56.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:56.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:56.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:56.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:57.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:57.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:57.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:57.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:58.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:58.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:58.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:58.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:59.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:56:59.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:56:59.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:56:59.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:00.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:00.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:00.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:00.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:01.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:01.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:01.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:01.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:02.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:02.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:02.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:02.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:03.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:03.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:03.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:03.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:04.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:04.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:04.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:04.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:05.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:05.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:05.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:05.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:06.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:06.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:06.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:06.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:07.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:07.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:07.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:07.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:08.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:08.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:08.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:08.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:09.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:09.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:09.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:09.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:10.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:10.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:10.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:10.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:11.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:11.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:11.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:11.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:12.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:12.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:12.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:12.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:13.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:13.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:13.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:13.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:14.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:14.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:14.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:14.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:15.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:15.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:15.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:15.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:16.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:16.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:16.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:16.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:17.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:17.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:17.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:17.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:18.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:18.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:18.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:18.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:19.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:19.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:19.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:19.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:20.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:20.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:20.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:20.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:21.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:21.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:21.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:21.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:22.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:22.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:22.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:22.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:23.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:23.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:23.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:23.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:24.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:24.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:24.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:24.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:25.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:25.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:25.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:25.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:26.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:26.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:26.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:26.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:27.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:27.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:27.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:27.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:28.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:28.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:28.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:28.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:29.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:29.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:29.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:29.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:30.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:30.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:30.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:30.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:31.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:31.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:31.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:31.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:32.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:32.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:32.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:32.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:33.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:33.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:33.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:33.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:34.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:34.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:34.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:34.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:35.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:35.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:35.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:35.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:36.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:36.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:36.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:36.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:37.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:37.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:37.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:37.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:38.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:38.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:38.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:38.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:39.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:39.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:39.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:39.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:40.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:40.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:40.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:40.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:41.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:41.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:41.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:41.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:42.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:42.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:42.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:42.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:43.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:43.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:43.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:43.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:44.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:44.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:44.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:44.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:45.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:45.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:45.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:45.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:46.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:46.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:46.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:46.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:47.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:47.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:47.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:47.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:48.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:48.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:48.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:48.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:49.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:49.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:49.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:49.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:50.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:50.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:50.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:50.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:51.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:51.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:51.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:51.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:52.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:52.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:52.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:52.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:53.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:53.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:53.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:53.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:54.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:54.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:54.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:54.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:55.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:55.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:55.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:55.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:56.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:56.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:56.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:56.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:57.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:57.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:57.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:57.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:58.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:58.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:58.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:58.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:59.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:57:59.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:57:59.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:57:59.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:00.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:00.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:00.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:00.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:01.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:01.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:01.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:01.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:02.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:02.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:02.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:02.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:03.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:03.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:03.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:03.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:04.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:04.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:04.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:04.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:05.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:05.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:05.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:05.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:06.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:06.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:06.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:06.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:07.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:07.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:07.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:07.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:08.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:08.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:08.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:08.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:09.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:09.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:09.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:09.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:10.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:10.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:10.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:10.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:11.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:11.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:11.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:11.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:12.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:12.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:12.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:12.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:13.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:13.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:13.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:13.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:14.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:14.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:14.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:14.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:15.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:15.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:15.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:15.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:16.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:16.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:16.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:16.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:17.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:17.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:17.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:17.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:18.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:18.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:18.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:18.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:19.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:19.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:19.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:19.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:20.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:20.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:20.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:20.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:21.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:21.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:21.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:21.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:22.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:22.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:22.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:22.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:23.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:23.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:23.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:23.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:24.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:24.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:24.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:24.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:25.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:25.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:25.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:25.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:26.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:26.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:26.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:26.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:27.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:27.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:27.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:27.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:28.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:28.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:28.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:28.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:29.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:29.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:29.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:29.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:30.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:30.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:30.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:30.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:31.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:31.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:31.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:31.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:32.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:32.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:32.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:32.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:33.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:33.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:33.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:33.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:34.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:34.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:34.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:34.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:35.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:35.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:35.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:35.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:36.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:36.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:36.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:36.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:37.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:37.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:37.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:37.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:38.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:38.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:38.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:38.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:39.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:39.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:39.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:39.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:40.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:40.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:40.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:40.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:41.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:41.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:41.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:41.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:42.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:42.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:42.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:42.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:43.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:43.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:43.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:43.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:44.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:44.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:44.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:44.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:45.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:45.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:45.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:45.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:46.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:46.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:46.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:46.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:47.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:47.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:47.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:47.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:48.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:48.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:48.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:48.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:49.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:49.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:49.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:49.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:50.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:50.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:50.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:50.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:51.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:51.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:51.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:51.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:52.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:52.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:52.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:52.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:53.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:53.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:53.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:53.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:54.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:54.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:54.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:54.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:55.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:55.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:55.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:55.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:56.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:56.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:56.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:56.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:57.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:57.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:57.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:57.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:58.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:58.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:58.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:58.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:59.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:58:59.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:58:59.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:58:59.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:00.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:00.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:00.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:00.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:01.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:01.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:01.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:01.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:02.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:02.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:02.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:02.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:03.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:03.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:03.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:03.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:04.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:04.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:04.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:04.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:05.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:05.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:05.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:05.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:06.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:06.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:06.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:06.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:07.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:07.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:07.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:07.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:08.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:08.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:08.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:08.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:09.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:09.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:09.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:09.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:10.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:10.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:10.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:10.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:11.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:11.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:11.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:11.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:12.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:12.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:12.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:12.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:13.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:13.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:13.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:13.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:14.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:14.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:14.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:14.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:15.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:15.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:15.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:15.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:16.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:16.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:16.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:16.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:17.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:17.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:17.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:17.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:18.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:18.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:18.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:18.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:19.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:19.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:19.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:19.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:20.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:20.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:20.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:20.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:21.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:21.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:21.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:21.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:22.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:22.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:22.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:22.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:23.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:23.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:23.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:23.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:24.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:24.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:24.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:24.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:25.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:25.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:25.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:25.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:26.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:26.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:26.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:26.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:27.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:27.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:27.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:27.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:28.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:28.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:28.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:28.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:29.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:29.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:29.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:29.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:30.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:30.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:30.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:30.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:31.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:31.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:31.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:31.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:32.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:32.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:32.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:32.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:33.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:33.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:33.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:33.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:34.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:34.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:34.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:34.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:35.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:35.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:35.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:35.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:36.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:36.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:36.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:36.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:37.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:37.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:37.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:37.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:38.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:38.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:38.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:38.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:39.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:39.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:39.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:39.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:40.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:40.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:40.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:40.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:41.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:41.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:41.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:41.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:42.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:42.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:42.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:42.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:43.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:43.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:43.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:43.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:44.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:44.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:44.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:44.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:45.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:45.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:45.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:45.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:46.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:46.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:46.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:46.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:47.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:47.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:47.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:47.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:48.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:48.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:48.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:48.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:49.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:49.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:49.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:49.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:50.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:50.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:50.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:50.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:51.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:51.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:51.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:51.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:52.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:52.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:52.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:52.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:53.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:53.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:53.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:53.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:54.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:54.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:54.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:54.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:55.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:55.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:55.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:55.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:56.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:56.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:56.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:56.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:57.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:57.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:57.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:57.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:58.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:58.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:58.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:58.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:59.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T15:59:59.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T15:59:59.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T15:59:59.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:00.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:00.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:00.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:00.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:01.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:01.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:01.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:01.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:02.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:02.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:02.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:02.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:03.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:03.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:03.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:03.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:04.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:04.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:04.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:04.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:05.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:05.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:05.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:05.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:06.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:06.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:06.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:06.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:07.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:07.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:07.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:07.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:08.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:08.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:08.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:08.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:09.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:09.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:09.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:09.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:10.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:10.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:10.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:10.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:11.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:11.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:11.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:11.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:12.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:12.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:12.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:12.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:13.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:13.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:13.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:13.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:14.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:14.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:14.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:14.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:15.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:15.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:15.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:15.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:16.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:16.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:16.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:16.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:17.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:17.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:17.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:17.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:18.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:18.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:18.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:18.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:19.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:19.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:19.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:19.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:20.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:20.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:20.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:20.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:21.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:21.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:21.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:21.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:22.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:22.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:22.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:22.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:23.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:23.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:23.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:23.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:24.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:24.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:24.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:24.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:25.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:25.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:25.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:25.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:26.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:26.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:26.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:26.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:27.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:27.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:27.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:27.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:28.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:28.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:28.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:28.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:29.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:29.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:29.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:29.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:30.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:30.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:30.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:30.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:31.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:31.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:31.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:31.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:32.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:32.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:32.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:32.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:33.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:33.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:33.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:33.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:34.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:34.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:34.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:34.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:35.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:35.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:35.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:35.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:36.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:36.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:36.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:36.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:37.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:37.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:37.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:37.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:38.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:38.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:38.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:38.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:39.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:39.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:39.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:39.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:40.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:40.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:40.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:40.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:41.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:41.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:41.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:41.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:42.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:42.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:42.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:42.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:43.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:43.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:43.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:43.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:44.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:44.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:44.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:44.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:45.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:45.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:45.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:45.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:46.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:46.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:46.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:46.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:47.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:47.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:47.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:47.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:48.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:48.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:48.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:48.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:49.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:49.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:49.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:49.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:50.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:50.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:50.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:50.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:51.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:51.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:51.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:51.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:52.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:52.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:52.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:52.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:53.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:53.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:53.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:53.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:54.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:54.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:54.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:54.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:55.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:55.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:55.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:55.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:56.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:56.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:56.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:56.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:57.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:57.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:57.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:57.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:58.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:58.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:58.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:58.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:59.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:00:59.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:00:59.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:00:59.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:00.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:00.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:00.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:00.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:01.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:01.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:01.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:01.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:02.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:02.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:02.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:02.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:03.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:03.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:03.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:03.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:04.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:04.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:04.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:04.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:05.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:05.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:05.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:05.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:06.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:06.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:06.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:06.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:07.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:07.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:07.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:07.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:08.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:08.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:08.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:08.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:09.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:09.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:09.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:09.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:10.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:10.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:10.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:10.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:11.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:11.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:11.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:11.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:12.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:12.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:12.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:12.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:13.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:13.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:13.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:13.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:14.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:14.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:14.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:14.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:15.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:15.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:15.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:15.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:16.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:16.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:16.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:16.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:17.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:17.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:17.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:17.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:18.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:18.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:18.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:18.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:19.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:19.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:19.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:19.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:20.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:20.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:20.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:20.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:21.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:21.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:21.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:21.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:22.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:22.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:22.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:22.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:23.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:23.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:23.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:23.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:24.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:24.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:24.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:24.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:25.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:25.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:25.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:25.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:26.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:26.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:26.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:26.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:27.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:27.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:27.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:27.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:28.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:28.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:28.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:28.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:29.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:29.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:29.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:29.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:30.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:30.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:30.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:30.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:31.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:31.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:31.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:31.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:32.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:32.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:32.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:32.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:33.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:33.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:33.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:33.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:34.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:34.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:34.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:34.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:35.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:35.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:35.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:35.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:36.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:36.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:36.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:36.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:37.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:37.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:37.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:37.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:38.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:38.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:38.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:38.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:39.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:39.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:39.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:39.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:40.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:40.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:40.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:40.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:41.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:41.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:41.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:41.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:42.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:42.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:42.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:42.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:43.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:43.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:43.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:43.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:44.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:44.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:44.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:44.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:45.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:45.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:45.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:45.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:46.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:46.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:46.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:46.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:47.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:47.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:47.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:47.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:48.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:48.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:48.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:48.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:49.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:49.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:49.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:49.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:50.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:50.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:50.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:50.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:51.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:51.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:51.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:51.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:52.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:52.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:52.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:52.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:53.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:53.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:53.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:53.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:54.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:54.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:54.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:54.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:55.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:55.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:55.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:55.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:56.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:56.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:56.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:56.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:57.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:57.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:57.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:57.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:58.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:58.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:58.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:58.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:59.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:01:59.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:01:59.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:01:59.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:00.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:00.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:00.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:00.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:01.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:01.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:01.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:01.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:02.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:02.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:02.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:02.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:03.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:03.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:03.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:03.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:04.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:04.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:04.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:04.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:05.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:05.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:05.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:05.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:06.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:06.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:06.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:06.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:07.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:07.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:07.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:07.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:08.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:08.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:08.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:08.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:09.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:09.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:09.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:09.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:10.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:10.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:10.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:10.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:11.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:11.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:11.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:11.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:12.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:12.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:12.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:12.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:13.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:13.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:13.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:13.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:14.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:14.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:14.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:14.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:15.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:15.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:15.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:15.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:16.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:16.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:16.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:16.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:17.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:17.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:17.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:17.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:18.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:18.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:18.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:18.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:19.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:19.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:19.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:19.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:20.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:20.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:20.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:20.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:21.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:21.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:21.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:21.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:22.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:22.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:22.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:22.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:23.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:23.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:23.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:23.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:24.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:24.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:24.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:24.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:25.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:25.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:25.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:25.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:26.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:26.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:26.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:26.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:27.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:27.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:27.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:27.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:28.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:28.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:28.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:28.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:29.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:29.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:29.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:29.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:30.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:30.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:30.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:30.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:31.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:31.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:31.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:31.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:32.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:32.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:32.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:32.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:33.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:33.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:33.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:33.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:34.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:34.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:34.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:34.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:35.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:35.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:35.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:35.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:36.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:36.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:36.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:36.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:37.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:37.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:37.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:37.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:38.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:38.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:38.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:38.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:39.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:39.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:39.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:39.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:40.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:40.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:40.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:40.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:41.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:41.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:41.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:41.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:42.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:42.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:42.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:42.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:43.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:43.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:43.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:43.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:44.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:44.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:44.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:44.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:45.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:45.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:45.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:45.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:46.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:46.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:46.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:46.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:47.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:47.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:47.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:47.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:48.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:48.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:48.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:48.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:49.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:49.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:49.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:49.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:50.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:50.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:50.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:50.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:51.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:51.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:51.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:51.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:52.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:52.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:52.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:52.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:53.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:53.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:53.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:53.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:54.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:54.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:54.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:54.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:55.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:55.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:55.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:55.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:56.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:56.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:56.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:56.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:57.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:57.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:58.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:58.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:58.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:58.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:59.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:59.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:59.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:02:59.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:02:59.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:02:59.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:00.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:00.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:01.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:01.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:01.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:01.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:02.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:02.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:02.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:02.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:03.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:03.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:03.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:03.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:04.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:04.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:04.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:04.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:05.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:05.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:05.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:05.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:06.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:06.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:06.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:06.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:07.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:07.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:07.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:07.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:08.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:08.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:08.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:08.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:09.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:09.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:09.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:09.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:10.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:10.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:10.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:10.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:11.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:11.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:11.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:11.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:11.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:11.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:12.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:12.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:12.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:12.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:13.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:13.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:13.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:13.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:14.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:14.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:14.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:14.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:15.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:15.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:15.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:15.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:16.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:16.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:17.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:17.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:17.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:17.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:18.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:18.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:18.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:18.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:18.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:18.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:19.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:19.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:19.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:19.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:20.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:20.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:21.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:21.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:21.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:21.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:22.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:22.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:22.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:22.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:22.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:22.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:23.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:23.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:23.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:23.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:24.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:24.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:24.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:24.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:25.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:25.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:26.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:26.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:26.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:26.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:27.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:27.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:27.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:27.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:28.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:28.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:28.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:28.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:29.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:29.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:29.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:29.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:30.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:30.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:30.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:30.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:31.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:31.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:31.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:31.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:31.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:31.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:32.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:32.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:32.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:32.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:33.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:33.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:33.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:33.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:34.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:34.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:34.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:34.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:35.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:35.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:35.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:35.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:36.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:36.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:36.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:36.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:37.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:37.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:37.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:37.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:38.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:38.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:39.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:39.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:39.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:39.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:40.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:40.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:40.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:40.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:41.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:41.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:41.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:41.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:42.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:42.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:42.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:42.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:42.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:42.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:43.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:43.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:44.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:44.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:44.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:44.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:45.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:45.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:45.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:45.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:45.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:45.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:46.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:46.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:46.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:46.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:47.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:47.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:47.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:47.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:48.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:48.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:48.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:48.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:49.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:49.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:49.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:49.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:50.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:50.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:50.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:50.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:51.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:51.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:51.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:51.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:52.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:52.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:52.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:52.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:53.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:53.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:53.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:53.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:54.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:54.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:54.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:54.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:55.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:55.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:55.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:55.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:56.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:56.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:56.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:56.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:57.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:57.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:57.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:57.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:58.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:58.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:58.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:58.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:59.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:03:59.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:03:59.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:03:59.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:00.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:00.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:00.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:00.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:01.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:01.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:01.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:01.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:02.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:02.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:02.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:02.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:03.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:03.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:03.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:03.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:04.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:04.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:04.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:04.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:05.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:05.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:05.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:05.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:06.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:06.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:06.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:06.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:07.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:07.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:07.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:07.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:08.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:08.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:08.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:08.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:09.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:09.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:09.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:09.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:10.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:10.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:10.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:10.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:11.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:11.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:11.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:11.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:12.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:12.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:12.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:12.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:13.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:13.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:13.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:13.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:14.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:14.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:14.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:14.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:15.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:15.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:15.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:15.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:16.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:16.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:16.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:16.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:17.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:17.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:17.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:17.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:18.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:18.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:18.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:18.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:19.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:19.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:19.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:19.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:20.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:20.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:20.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:20.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:21.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:21.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:21.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:21.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:22.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:22.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:22.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:22.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:23.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:23.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:23.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:23.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:24.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:24.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:24.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:24.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:25.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:25.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:26.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:25.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:26.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:26.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:27.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:27.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:27.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:27.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:27.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:27.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:28.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:28.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:28.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:28.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:29.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:29.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:29.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:29.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:30.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:30.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:30.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:30.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:31.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:31.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:31.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:31.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:32.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:32.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:32.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:32.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:33.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:33.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:33.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:33.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:34.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:34.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:34.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:34.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:35.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:35.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:35.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:35.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:36.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:36.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:36.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:36.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:37.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:37.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:37.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:37.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:38.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:38.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:38.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:38.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:39.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:39.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:39.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:39.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:40.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:40.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:40.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:40.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:41.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:41.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:41.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:41.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:42.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:42.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:42.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:42.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:43.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:43.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:43.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:43.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:44.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:44.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:44.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:44.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:45.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:45.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:45.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:45.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:46.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:46.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:46.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:46.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:47.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:47.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:47.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:47.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:48.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:47.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:48.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:48.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:49.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:49.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:49.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:49.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:50.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:50.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:50.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:50.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:51.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:51.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:51.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:51.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:52.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:52.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:52.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:52.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:53.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:53.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:53.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:53.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:54.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:54.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:54.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:54.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:55.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:55.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:55.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:55.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:56.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:56.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:56.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:56.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:57.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:57.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:57.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:57.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:58.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:58.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:58.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:58.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:59.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:04:59.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:04:59.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:04:59.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:00.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:00.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:00.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:00.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:01.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:01.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:01.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:01.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:02.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:02.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:02.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:02.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:03.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:03.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:03.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:03.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:04.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:04.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:04.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:04.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:05.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:05.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:05.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:05.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:06.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:06.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:06.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:06.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:07.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:07.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:07.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:07.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:08.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:08.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:08.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:08.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:09.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:09.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:09.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:09.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:09.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:09.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:10.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:10.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:10.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:10.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:11.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:11.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:11.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:11.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:12.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:12.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:12.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:12.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:13.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:13.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:13.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:13.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:14.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:14.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:14.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:14.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:15.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:15.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:15.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:15.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:16.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:16.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:16.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:16.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:17.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:17.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:18.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:17.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:18.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:18.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:19.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:19.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:19.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:19.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:20.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:20.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:20.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:20.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:20.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:20.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:21.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:21.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:21.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:21.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:22.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:22.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:22.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:22.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:23.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:23.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:23.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:23.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:24.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:24.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:24.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:24.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:25.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:25.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:25.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:25.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:26.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:26.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:27.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:27.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:27.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:27.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:28.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:28.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:28.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:28.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:28.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:28.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:29.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:29.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:30.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:30.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:30.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:30.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:31.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:31.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:31.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:31.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:32.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:32.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:32.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:32.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:33.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:33.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:33.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:33.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:33.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:33.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:34.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:34.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:35.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:35.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:35.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:35.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:36.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:36.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:36.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:36.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:36.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:36.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:37.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:37.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:38.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:38.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:38.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:38.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:38.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:38.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:39.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:39.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:40.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:40.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:40.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:40.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:41.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:41.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:41.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:41.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:42.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:42.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:42.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:42.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:42.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:42.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:43.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:43.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:44.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:44.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:44.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:44.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:45.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:45.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:45.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:45.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:46.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:46.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:46.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:46.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:47.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:47.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:47.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:47.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:48.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:48.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:48.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:48.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:49.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:49.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:49.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:49.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:50.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:50.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:50.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:50.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:51.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:51.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:51.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:51.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:52.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:52.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:52.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:52.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:53.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:53.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:53.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:53.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:54.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:54.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:54.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:54.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:55.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:55.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:55.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:55.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:56.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:56.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:56.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:56.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:57.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:57.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:57.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:57.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:58.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:58.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:58.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:58.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:59.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:05:59.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:05:59.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:05:59.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:00.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:00.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:00.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:00.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:01.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:01.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:01.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:01.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:02.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:02.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:02.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:02.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:03.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:03.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:03.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:03.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:04.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:04.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:04.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:04.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:05.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:05.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:05.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:05.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:06.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:06.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:06.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:06.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:07.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:07.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:07.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:07.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:08.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:08.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:08.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:08.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:09.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:09.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:09.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:09.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:10.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:10.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:10.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:10.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:11.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:11.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:11.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:11.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:12.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:12.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:12.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:12.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:13.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:13.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:13.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:13.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:14.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:14.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:14.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:14.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:15.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:15.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:15.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:15.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:16.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:16.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:16.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:16.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:17.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:17.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:17.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:17.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:17.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:17.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:18.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:18.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:18.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:18.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:19.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:19.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:19.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:19.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:20.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:20.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:20.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:20.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:21.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:21.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:22.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:21.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:22.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:22.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:23.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:23.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:23.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:23.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:24.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:24.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:24.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:24.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:25.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:25.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:25.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:25.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:26.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:26.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:26.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:26.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:27.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:27.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:27.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:27.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:28.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:28.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:28.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:28.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:29.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:29.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:29.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:29.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:30.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:30.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:30.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:30.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:31.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:31.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:31.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:31.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:32.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:32.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:32.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:32.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:33.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:33.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:33.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:33.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:34.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:34.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:34.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:34.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:35.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:35.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:35.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:35.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:36.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:36.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:36.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:36.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:37.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:37.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:37.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:37.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:38.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:38.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:38.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:38.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:39.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:39.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:39.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:39.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:40.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:40.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:40.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:40.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:41.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:41.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:41.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:41.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:42.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:42.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:42.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:42.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:43.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:43.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:43.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:43.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:44.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:44.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:44.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:44.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:45.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:45.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:45.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:45.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:46.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:46.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:46.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:46.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:47.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:47.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:47.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:47.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:48.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:48.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:48.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:48.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:49.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:49.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:49.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:49.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:50.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:50.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:50.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:50.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:51.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:51.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:51.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:51.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:52.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:52.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:52.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:52.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:53.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:53.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:53.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:53.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:54.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:54.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:54.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:54.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:55.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:55.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:55.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:55.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:56.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:56.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:56.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:56.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:57.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:57.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:57.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:57.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:58.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:58.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:58.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:58.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:59.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:06:59.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:06:59.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:06:59.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:00.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:00.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:00.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:00.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:01.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:01.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:01.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:01.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:02.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:02.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:02.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:02.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:03.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:03.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:03.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:03.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:04.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:04.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:04.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:04.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:05.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:05.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:05.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:05.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:06.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:06.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:06.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:06.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:07.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:07.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:07.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:07.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:08.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:08.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:08.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:08.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:09.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:09.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:09.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:09.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:10.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:10.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:10.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:10.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:11.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:11.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:11.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:11.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:12.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:12.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:12.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:12.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:12.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:12.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:13.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:13.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:13.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:13.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:14.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:14.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:14.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:14.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:15.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:15.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:15.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:15.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:16.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:16.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:16.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:16.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:17.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:17.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:17.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:17.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:18.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:18.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:18.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:18.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:19.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:19.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:19.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:19.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:20.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:20.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:20.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:20.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:21.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:21.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:21.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:21.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:22.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:22.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:22.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:22.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:23.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:23.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:23.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:23.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:24.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:24.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:24.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:24.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:25.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:25.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:25.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:25.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:26.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:26.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:26.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:26.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:27.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:27.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:27.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:27.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:28.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:28.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:28.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:28.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:29.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:29.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:29.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:29.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:30.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:30.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:30.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:30.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:31.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:31.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:31.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:31.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:32.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:32.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:32.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:32.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:33.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:33.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:34.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:34.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:34.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:34.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:34.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:34.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:35.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:35.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:36.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:36.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:36.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:36.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:37.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:37.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:37.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:37.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:37.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:37.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:38.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:38.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:38.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:38.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:39.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:39.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:39.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:39.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:40.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:40.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:40.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:40.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:41.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:41.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:41.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:41.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:42.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:42.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:42.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:42.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:43.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:43.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:43.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:43.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:44.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:44.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:44.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:44.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:45.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:45.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:45.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:45.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:46.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:46.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:46.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:46.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:47.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:47.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:47.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:47.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:48.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:48.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:48.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:48.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:49.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:49.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:49.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:49.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:50.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:50.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:50.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:50.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:51.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:51.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:51.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:51.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:52.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:52.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:52.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:52.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:53.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:53.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:53.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:53.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:54.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:54.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:54.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:54.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:55.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:55.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:55.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:55.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:56.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:56.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:56.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:56.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:57.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:57.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:57.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:57.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:58.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:58.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:58.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:58.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:59.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:07:59.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:07:59.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:07:59.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:00.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:00.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:00.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:00.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:01.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:01.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:01.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:01.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:02.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:02.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:02.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:02.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:03.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:03.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:03.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:03.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:04.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:04.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:04.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:04.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:05.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:05.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:05.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:05.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:06.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:06.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:06.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:06.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:07.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:07.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:07.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:07.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:08.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:08.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:08.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:08.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:09.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:09.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:09.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:09.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:10.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:10.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:10.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:10.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:11.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:11.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:11.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:11.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:12.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:12.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:12.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:12.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:13.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:13.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:13.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:13.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:14.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:14.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:14.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:14.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:15.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:15.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:15.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:15.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:16.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:16.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:16.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:16.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:17.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:17.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:17.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:17.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:18.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:18.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:18.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:18.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:19.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:19.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:19.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:19.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:20.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:20.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:20.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:20.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:21.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:21.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:21.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:21.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:22.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:22.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:22.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:22.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:23.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:23.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:23.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:23.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:24.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:24.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:24.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:24.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:25.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:25.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:25.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:25.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:26.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:26.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:26.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:26.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:27.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:27.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:27.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:27.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:28.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:28.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:28.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:28.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:29.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:29.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:29.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:29.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:30.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:30.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:30.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:30.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:31.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:31.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:31.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:31.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:32.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:32.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:32.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:32.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:33.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:33.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:33.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:33.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:34.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:34.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:34.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:34.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:35.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:35.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:35.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:35.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:36.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:36.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:36.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:36.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:37.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:37.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:37.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:37.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:38.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:38.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:38.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:38.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:39.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:39.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:39.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:39.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:40.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:40.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:40.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:40.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:41.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:41.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:41.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:41.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:42.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:42.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:42.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:42.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:43.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:43.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:43.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:43.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:44.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:44.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:44.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:44.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:45.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:45.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:45.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:45.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:46.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:46.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:46.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:46.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:47.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:47.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:47.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:47.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:48.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:48.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:48.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:48.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:49.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:49.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:49.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:49.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:50.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:50.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:50.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:50.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:51.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:51.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:51.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:51.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:52.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:52.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:52.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:52.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:53.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:53.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:53.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:53.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:54.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:54.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:54.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:54.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:55.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:55.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:55.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:55.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:56.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:56.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:56.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:56.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:57.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:57.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:57.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:57.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:58.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:58.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:58.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:58.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:59.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:08:59.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:08:59.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:08:59.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:00.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:00.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:00.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:00.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:01.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:01.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:01.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:01.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:02.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:02.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:02.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:02.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:03.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:03.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:03.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:03.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:04.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:04.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:04.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:04.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:05.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:05.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:05.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:05.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:06.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:06.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:06.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:06.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:07.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:07.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:07.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:07.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:08.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:08.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:08.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:08.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:09.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:09.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:09.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:09.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:10.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:10.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:10.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:10.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:11.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:11.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:11.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:11.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:12.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:12.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:12.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:12.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:13.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:13.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:13.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:13.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:14.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:14.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:14.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:14.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:15.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:15.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:15.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:15.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:16.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:16.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:16.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:16.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:17.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:17.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:17.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:17.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:18.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:18.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:18.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:18.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:19.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:19.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:19.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:19.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:20.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:20.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:20.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:20.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:21.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:21.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:21.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:21.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:22.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:22.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:22.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:22.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:23.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:23.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:23.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:23.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:24.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:24.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:24.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:24.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:25.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:25.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:25.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:25.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:26.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:26.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:26.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:26.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:27.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:27.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:27.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:27.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:28.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:28.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:28.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:28.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:29.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:29.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:29.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:29.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:30.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:30.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:30.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:30.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:31.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:31.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:31.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:31.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:32.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:32.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:32.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:32.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:33.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:33.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:33.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:33.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:34.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:34.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:34.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:34.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:35.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:35.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:35.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:35.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:36.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:36.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:36.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:36.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:37.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:37.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:37.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:37.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:38.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:38.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:38.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:38.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:39.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:39.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:39.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:39.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:40.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:40.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:40.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:40.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:41.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:41.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:41.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:41.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:42.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:42.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:42.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:42.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:43.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:43.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:43.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:43.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:44.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:44.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:44.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:44.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:45.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:45.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:45.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:45.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:46.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:46.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:46.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:46.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:47.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:47.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:47.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:47.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:48.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:48.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:48.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:48.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:49.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:49.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:49.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:49.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:50.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:50.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:50.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:50.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:51.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:51.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:51.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:51.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:52.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:52.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:52.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:52.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:53.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:53.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:53.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:53.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:54.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:54.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:54.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:54.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:55.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:55.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:55.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:55.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:56.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:56.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:56.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:56.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:57.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:57.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:57.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:57.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:58.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:58.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:58.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:58.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:59.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:09:59.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:09:59.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:09:59.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:00.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:00.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:00.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:00.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:01.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:01.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:01.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:01.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:02.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:02.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:02.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:02.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:03.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:03.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:03.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:03.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:04.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:04.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:04.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:04.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:05.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:05.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:05.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:05.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:06.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:06.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:06.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:06.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:07.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:07.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:07.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:07.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:08.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:08.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:08.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:08.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:09.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:09.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:09.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:09.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:10.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:10.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:10.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:10.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:11.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:11.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:11.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:11.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:12.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:12.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:12.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:12.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:13.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:13.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:13.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:13.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:14.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:14.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:14.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:14.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:15.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:15.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:15.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:15.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:16.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:16.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:16.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:16.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:17.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:17.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:17.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:17.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:18.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:18.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:18.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:18.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:19.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:19.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:19.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:19.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:20.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:20.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:20.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:20.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:21.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:21.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:21.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:21.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:22.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:22.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:22.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:22.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:23.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:23.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:23.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:23.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:24.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:24.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:24.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:24.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:25.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:25.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:25.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:25.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:26.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:26.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:26.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:26.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 9 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:27.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:27.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:27.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:27.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:28.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:28.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:28.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:28.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:29.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:29.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:29.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:29.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:30.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:30.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:30.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:30.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:31.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:31.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:31.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:31.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:32.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:32.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:32.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:32.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:33.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:33.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:33.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:33.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:34.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:34.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:34.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:34.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:35.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:35.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:35.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:35.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:36.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:36.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:36.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:36.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:37.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:37.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:37.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:37.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:38.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:38.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:38.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:38.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:39.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:39.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:39.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:39.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:40.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:40.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:40.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:40.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:41.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:41.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:41.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:41.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:42.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:42.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:42.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:42.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:43.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:43.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:43.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:43.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:44.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:44.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:44.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:44.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:45.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:45.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:45.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:45.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:46.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:46.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:46.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:46.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:47.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:47.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:47.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:47.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:48.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:48.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:48.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:48.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:49.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:49.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:49.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:49.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:50.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:50.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:50.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:50.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:51.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:51.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:51.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:51.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:52.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:52.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:52.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:52.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:53.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:53.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:53.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:53.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:54.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:54.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:54.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:54.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:55.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:55.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:55.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:55.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:56.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:56.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:56.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:56.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:10:57.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:57.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:57.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:57.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:58.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:58.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:58.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:58.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:59.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:10:59.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:10:59.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:10:59.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:00.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:00.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:00.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:00.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:01.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:01.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:01.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:01.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:02.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:02.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:02.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:02.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:03.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:03.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:03.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:03.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:04.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:04.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:04.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:04.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:05.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:05.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:05.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:05.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:06.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:06.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:06.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:06.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:07.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:07.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:07.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:07.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:08.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:08.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:08.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:08.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:09.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:09.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:09.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:09.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:10.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:10.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:10.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:10.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:11.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:11.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:11.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:11.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:12.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:12.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:12.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:12.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:13.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:13.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:13.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:13.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:14.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:14.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:14.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:14.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:15.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:15.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:15.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:15.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:16.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:16.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:16.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:16.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:17.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:17.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:17.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:17.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:18.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:18.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:18.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:18.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:19.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:19.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:19.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:19.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:20.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:20.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:20.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:20.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:21.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:21.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:21.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:21.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:22.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:22.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:22.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:22.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:23.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:23.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:23.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:23.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:24.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:24.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:24.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:24.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:25.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:25.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:25.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:25.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:26.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:26.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:26.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:26.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:27.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:27.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:27.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:27.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:28.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:28.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:28.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:28.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:29.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:29.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:29.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:29.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:30.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:30.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:30.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:30.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:31.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:31.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:31.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:31.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:32.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:32.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:32.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:32.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:33.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:33.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:33.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:33.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:34.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:34.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:34.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:34.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:35.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:35.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:35.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:35.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:36.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:36.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:36.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:36.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:37.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:37.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:37.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:37.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:38.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:38.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:38.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:38.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:39.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:39.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:39.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:39.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:40.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:40.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:40.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:40.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:41.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:41.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:41.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:41.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:42.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:42.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:42.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:42.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:43.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:43.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:43.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:43.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:44.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:44.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:44.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:44.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:45.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:45.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:45.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:45.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:46.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:46.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:46.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:46.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:47.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:47.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:47.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:47.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:48.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:48.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:48.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:48.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:49.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:49.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:49.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:49.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:50.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:50.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:50.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:50.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:50.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:50.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:51.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:51.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:51.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:51.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:52.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:52.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:53.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:53.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:53.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:53.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:54.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:54.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:54.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:54.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:55.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:55.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:55.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:55.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:56.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:56.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:56.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:56.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:57.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:57.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:57.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:57.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:58.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:58.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:58.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:58.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:59.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:11:59.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:11:59.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:11:59.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:00.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:00.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:00.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:00.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:01.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:01.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:01.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:01.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:02.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:02.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:02.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:02.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:03.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:03.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:03.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:03.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:04.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:04.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:04.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:04.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:05.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:05.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:05.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:05.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:06.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:06.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:06.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:06.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:07.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:07.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:07.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:07.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:08.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:08.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:08.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:08.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:09.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:09.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:09.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:09.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:10.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:10.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:10.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:10.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:11.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:11.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:11.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:11.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:12.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:12.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:12.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:12.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:13.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:13.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:13.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:13.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:14.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:14.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:14.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:14.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:15.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:15.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:15.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:15.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:16.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:16.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:16.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:16.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:17.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:17.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:17.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:17.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:18.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:18.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:18.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:18.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:19.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:19.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:19.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:19.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:20.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:20.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:20.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:20.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:21.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:21.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:21.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:21.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:22.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:22.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:22.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:22.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:23.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:23.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:23.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:23.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:24.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:24.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:24.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:24.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:25.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:25.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:25.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:25.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:26.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:26.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:26.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:26.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:27.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:27.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:27.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:27.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:28.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:28.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:28.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:28.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:29.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:29.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:29.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:29.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:30.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:30.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:30.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:30.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:31.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:31.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:31.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:31.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:32.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:32.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:32.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:32.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:33.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:33.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:33.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:33.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:34.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:34.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:34.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:34.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:35.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:35.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:35.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:35.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:36.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:36.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:36.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:36.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:37.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:37.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:37.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:37.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:38.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:38.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:38.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:38.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:39.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:39.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:39.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:39.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:40.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:40.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:40.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:40.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:41.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:41.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:41.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:41.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:42.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:42.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:42.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:42.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:43.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:43.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:43.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:43.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:44.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:44.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:44.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:44.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:45.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:45.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:45.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:45.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:46.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:46.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:46.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:46.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:47.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:47.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:47.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:47.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:48.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:48.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:48.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:48.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:49.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:49.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:49.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:49.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:50.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:50.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:50.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:50.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:51.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:51.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:51.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:51.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:52.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:52.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:52.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:52.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:53.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:53.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:53.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:53.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:54.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:54.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:54.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:54.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:55.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:55.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:56.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:56.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:56.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:56.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:56.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:56.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:57.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:57.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:57.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:57.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:58.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:58.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:59.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:12:59.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:12:59.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:12:59.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:00.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:00.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:00.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:00.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:01.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:00.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:01.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:01.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:02.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:02.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:02.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:02.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:03.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:03.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:03.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:03.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:04.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:04.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:04.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:04.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:05.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:05.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:05.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:05.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:06.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:06.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:06.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:06.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:07.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:07.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:07.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:07.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:08.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:08.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:08.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:08.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:09.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:09.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:09.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:09.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:10.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:10.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:10.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:10.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:11.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:11.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:11.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:11.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:12.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:12.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:12.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:12.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:13.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:13.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:13.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:13.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:14.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:14.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:14.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:14.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:15.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:15.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:15.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:15.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:16.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:16.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:16.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:16.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:17.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:17.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:17.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:17.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:18.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:18.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:18.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:18.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:19.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:19.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:19.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:19.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:20.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:20.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:20.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:20.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:21.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:21.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:21.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:21.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:22.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:22.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:22.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:22.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:23.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:23.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:23.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:23.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:24.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:24.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:24.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:24.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:25.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:25.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:25.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:25.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:26.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:26.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:26.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:26.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:27.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:27.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:27.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:27.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:28.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:28.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:28.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:28.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:29.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:29.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:29.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:29.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:30.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:30.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:30.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:30.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:31.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:31.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:31.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:31.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:32.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:32.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:32.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:32.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:33.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:33.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:33.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:33.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:34.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:34.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:34.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:34.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:35.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:35.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:35.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:35.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:36.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:36.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:36.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:36.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:37.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:37.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:37.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:37.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:38.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:38.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:38.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:38.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:39.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:39.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:39.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:39.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:40.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:40.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:40.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:40.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:41.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:41.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:41.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:41.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:42.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:42.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:42.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:42.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:43.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:43.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:43.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:43.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:44.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:44.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:44.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:44.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:45.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:45.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:45.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:45.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:46.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:46.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:46.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:46.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:47.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:47.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:47.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:47.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:48.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:48.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:48.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:48.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:49.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:49.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:49.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:49.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:50.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:50.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:50.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:50.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:51.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:51.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:51.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:51.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:52.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:52.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:52.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:52.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:53.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:53.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:53.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:53.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:54.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:54.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:54.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:54.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:55.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:55.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:55.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:55.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:56.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:56.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:56.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:56.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:57.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:57.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:57.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:57.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:57.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:57.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:58.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:58.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:58.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:13:58.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:13:59.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:13:59.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:00.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:00.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:00.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:00.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:01.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:01.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:01.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:01.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:02.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:02.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:02.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:02.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:02.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:02.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:03.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:03.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:03.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:03.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:04.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:04.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:05.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:05.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:05.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:05.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:05.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:05.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:06.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:06.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:06.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:06.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:07.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:07.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:07.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:07.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:08.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:08.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:08.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:08.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:09.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:09.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:09.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:09.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:10.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:10.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:10.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:10.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:11.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:11.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:12.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:12.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:12.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:12.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:13.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:13.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:13.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:13.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:14.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:14.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:14.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:14.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:14.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:14.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:15.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:15.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:15.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:15.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:16.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:16.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:16.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:16.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:17.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:17.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:17.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:17.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:18.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:18.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:18.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:18.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:19.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:19.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:19.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:19.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:20.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:20.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:20.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:20.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:21.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:21.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:21.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:21.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:22.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:22.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:22.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:22.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:22.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:22.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:23.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:23.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:23.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:23.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:24.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:24.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:24.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:24.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:25.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:25.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:25.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:25.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:26.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:26.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:26.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:26.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:27.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:27.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:27.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:27.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:28.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:28.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:29.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:29.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:29.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:29.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:30.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:30.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:30.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:30.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:31.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:31.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:31.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:31.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:32.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:32.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:32.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:32.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:33.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:33.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:33.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:33.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:34.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:34.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:34.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:34.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:35.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:35.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:35.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:35.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:36.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:36.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:36.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:36.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:37.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:37.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:37.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:37.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:38.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:38.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:38.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:38.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:39.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:39.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:39.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:39.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:40.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:40.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:40.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:40.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:41.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:41.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:42.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:42.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:42.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:42.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:43.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:43.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:43.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:43.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:44.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:44.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:44.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:44.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:44.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:44.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:45.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:45.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:45.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:45.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:46.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:46.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:46.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:46.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:47.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:47.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:47.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:47.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:48.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:48.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:48.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:48.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:49.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:49.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:49.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:49.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:50.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:50.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:51.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:51.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:51.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:51.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:51.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:51.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:52.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:52.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:52.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:52.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:53.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:53.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:53.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:53.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:54.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:54.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:54.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:54.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:55.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:55.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:55.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:55.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:56.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:56.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:56.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:56.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:57.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:57.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:57.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:57.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:58.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:58.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:58.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:58.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:59.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:14:59.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:14:59.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:14:59.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:00.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:00.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:00.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:00.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:01.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:01.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:01.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:01.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:02.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:02.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:02.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:02.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:03.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:03.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:03.748 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T16:15:03.747+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ddecea29e0 msgr2=0x55ddece9beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T16:15:03.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:03.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:04.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:04.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:04.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:04.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:05.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:05.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:05.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:05.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:06.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:06.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:07.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:06.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:07.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:07.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:07.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:07.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:08.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:08.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:09.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:09.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:09.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:09.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:10.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:10.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:10.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:10.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:11.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:11.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:11.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:11.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:12.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:12.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:12.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:12.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:13.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:13.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:13.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:13.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:14.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:14.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:14.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:14.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:15.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:15.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:15.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:15.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:16.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:16.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:16.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:16.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:17.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:17.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:17.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:17.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:18.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:18.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:18.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:18.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:19.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:19.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:19.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:19.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:20.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:20.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:20.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:20.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:21.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:21.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:21.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:21.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:21.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:21.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:22.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:22.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:23.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:23.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:23.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:23.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:24.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:24.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:24.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:24.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:24.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:24.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:25.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:25.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:25.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:25.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:26.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:26.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:26.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:26.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:27.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:27.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:27.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:27.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:28.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:28.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:28.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:28.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:29.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:29.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:29.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:29.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:30.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:30.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:30.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:30.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:31.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:31.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:31.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:31.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:32.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:32.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:32.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:32.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:33.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:33.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:33.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:33.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:34.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:34.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:34.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:34.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:35.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:35.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:35.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:35.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:36.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:36.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:36.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:36.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:37.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:37.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:37.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:37.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:38.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:38.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:38.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:38.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:39.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:39.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:40.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:40.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:40.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:40.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:41.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:41.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:41.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:41.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:42.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:41.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:42.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:42.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:43.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:43.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:43.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:43.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:43.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:43.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:44.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:44.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:44.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:44.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:45.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:45.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:45.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:45.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:46.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:46.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:46.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:46.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:47.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:47.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:47.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:47.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:48.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:48.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:48.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:48.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:49.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:49.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:49.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:49.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:50.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:50.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:50.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:50.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:51.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:51.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:51.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:51.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:52.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:52.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:52.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:52.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:53.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:53.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:53.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:53.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:54.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:54.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:54.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:54.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:55.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:55.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:55.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:55.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:56.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:56.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:56.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:56.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:57.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:57.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:57.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:57.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:58.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:58.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:58.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:58.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:59.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:15:59.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:15:59.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:15:59.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:00.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:00.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:00.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:00.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:01.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:01.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:01.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:01.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:02.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:02.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:02.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:02.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:03.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:03.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:03.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:03.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:04.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:04.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:04.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:04.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:05.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:05.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:05.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:05.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:06.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:06.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:06.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:06.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:07.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:07.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:07.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:07.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:08.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:08.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:08.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:08.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:09.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:09.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:09.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:09.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:10.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:10.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:10.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:10.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:11.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:11.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:11.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:11.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:12.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:12.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:12.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:12.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:13.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:13.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:14.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:14.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:14.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:14.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:14.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:14.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:15.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:15.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:15.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:15.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:16.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:16.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:17.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:17.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:17.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:17.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:18.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:18.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:18.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:18.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:18.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:18.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:19.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:19.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:19.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:19.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:20.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:20.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:20.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:20.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:21.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:21.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:22.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:22.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:22.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:22.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:23.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:23.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:23.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:23.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:23.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:23.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:24.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:24.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:24.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:24.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:25.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:25.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:25.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:25.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:26.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:26.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:26.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:26.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:27.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:27.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:27.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:27.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:28.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:28.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:28.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:28.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:29.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:29.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:29.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:29.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:30.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:30.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:30.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:30.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:31.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:31.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:31.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:31.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:32.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:32.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:32.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:32.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:33.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:33.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:33.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:33.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:34.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:34.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:34.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:34.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:35.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:35.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:35.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:35.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:36.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:36.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:36.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:36.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:37.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:37.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:37.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:37.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:38.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:38.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:38.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:38.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:39.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:39.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:39.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:39.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:40.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:40.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:40.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:40.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:41.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:41.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:41.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:41.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:42.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:42.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:42.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:42.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:43.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:43.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:43.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:43.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:44.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:44.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:44.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:44.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:45.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:45.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:45.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:45.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:46.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:46.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:47.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:47.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:47.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:47.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:48.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:48.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:48.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:48.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:49.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:49.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:49.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:49.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:50.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:50.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:50.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:50.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:51.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:51.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:51.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:51.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:52.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:52.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:52.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:52.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:53.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:53.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:53.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:53.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:54.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:54.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:54.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:54.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:55.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:55.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:55.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:55.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:56.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:56.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:56.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:56.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:57.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:57.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:57.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:57.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:58.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:58.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:58.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:58.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:59.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:16:59.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:16:59.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:16:59.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:00.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:00.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:00.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:00.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:01.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:01.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:01.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:01.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:02.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:02.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:02.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:02.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:03.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:03.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:03.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:03.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:04.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:04.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:04.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:04.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:05.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:05.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:05.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:05.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:06.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:06.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:06.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:06.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:07.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:07.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:07.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:07.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:08.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:08.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:08.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:08.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:09.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:09.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:09.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:09.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:10.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:10.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:10.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:10.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:11.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:11.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:11.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:11.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:12.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:12.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:12.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:12.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:13.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:13.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:13.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:13.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:14.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:14.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:14.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:14.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:15.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:15.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:15.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:15.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:16.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:16.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:16.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:16.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:17.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:17.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:17.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:17.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:18.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:18.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:18.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:18.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:19.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:19.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:19.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:19.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:20.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:20.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:20.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:20.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:21.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:21.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:21.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:21.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:22.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:22.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:22.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:22.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:23.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:23.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:23.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:23.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:24.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:24.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:24.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:24.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:25.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:25.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:25.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:25.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:26.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:26.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:26.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:26.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:27.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:27.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:27.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:27.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:28.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:28.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:28.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:28.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:29.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:29.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:29.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:29.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:30.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:30.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:30.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:30.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:31.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:31.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:31.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:31.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:32.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:32.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:32.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:32.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:33.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:33.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:33.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:33.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:34.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:34.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:34.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:34.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:35.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:35.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:35.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:35.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:36.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:36.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:36.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:36.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:37.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:37.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:37.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:37.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:37.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:37.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:38.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:38.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:39.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:39.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:39.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:39.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:40.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:40.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:40.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:40.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:40.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:40.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:41.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:41.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:42.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:42.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:42.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:42.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:42.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:43.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:43.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:43.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:43.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:43.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:44.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:44.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:44.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:44.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:45.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:45.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:45.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:45.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:46.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:46.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:46.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:46.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:47.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:47.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:48.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:48.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:48.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:48.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:48.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:48.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:49.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:49.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:49.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:49.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:50.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:50.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:50.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:50.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:51.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:51.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:51.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:51.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:52.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:52.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:52.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:52.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:53.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:53.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:53.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:53.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:54.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:54.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:54.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:54.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:55.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:55.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:55.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:55.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:56.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:56.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:56.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:56.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:57.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:57.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:57.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:57.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:58.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:58.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:58.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:58.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:59.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:17:59.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:17:59.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:17:59.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:00.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:00.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:01.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:01.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:01.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:01.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:02.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:02.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:02.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:02.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:03.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:03.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:03.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:03.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:04.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:04.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:04.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:04.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:05.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:05.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:05.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:05.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:06.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:06.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:06.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:06.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:07.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:07.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:07.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:07.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:08.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:08.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:08.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:08.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:09.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:09.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:09.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:09.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:10.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:10.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:10.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:10.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:11.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:11.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:11.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:11.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:12.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:12.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:12.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:12.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:12.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:12.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:13.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:13.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:14.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:14.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:14.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:14.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:15.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:15.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:15.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:15.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:16.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:16.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:16.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:16.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:17.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:17.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:17.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:17.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:18.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:18.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:18.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:18.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:19.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:19.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:19.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:19.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:20.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:20.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:20.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:20.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:21.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:21.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:21.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:21.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:22.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:22.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:22.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:22.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:23.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:23.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:23.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:23.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:24.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:24.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:24.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:24.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:25.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:25.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:25.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:25.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:26.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:26.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:26.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:26.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:27.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:27.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:27.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:27.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:28.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:28.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:28.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:28.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:29.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:29.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:29.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:29.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:30.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:30.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:30.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:30.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:31.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:31.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:31.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:31.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:32.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:32.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:32.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:32.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:33.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:33.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:33.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:33.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:34.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:34.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:34.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:34.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:35.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:35.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:35.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:35.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:36.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:36.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:36.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:36.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:37.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:37.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:37.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:37.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:38.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:38.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:38.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:38.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:39.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:39.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:39.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:39.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:40.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:40.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:40.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:40.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:41.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:41.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:41.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:41.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:42.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:42.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:42.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:42.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:43.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:43.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:43.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:43.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:44.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:44.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:44.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:44.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:45.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:45.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:45.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:45.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:46.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:46.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:46.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:46.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:47.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:47.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:47.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:47.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:48.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:48.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:48.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:48.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:49.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:49.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:49.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:49.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:50.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:50.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:50.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:50.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:51.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:51.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:51.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:51.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:52.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:52.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:52.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:52.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:53.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:53.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:53.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:53.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:54.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:54.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:54.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:54.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:55.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:55.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:55.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:55.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:56.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:56.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:56.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:56.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:57.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:57.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:57.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:57.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:57.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:57.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:58.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:58.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:58.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:58.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:59.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:18:59.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:18:59.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:18:59.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:00.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:00.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:00.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:00.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:01.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:01.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:01.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:01.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:02.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:02.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:02.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:02.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:03.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:03.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:03.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:03.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:04.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:04.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:04.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:04.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:05.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:05.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:05.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:05.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:06.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:06.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:06.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:06.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:07.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:07.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:07.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:07.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:08.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:08.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:08.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:08.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:09.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:09.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:09.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:09.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:10.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:10.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:10.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:10.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:11.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:11.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:11.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:11.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:12.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:12.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:12.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:12.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:13.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:13.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:13.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:13.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:14.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:14.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:14.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:14.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:15.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:15.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:15.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:15.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:16.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:16.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:16.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:16.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:17.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:17.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:17.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:17.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:18.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:18.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:18.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:18.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:19.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:19.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:19.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:19.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:20.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:20.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:20.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:20.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:21.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:21.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:21.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:21.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:22.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:22.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:22.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:22.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:23.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:23.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:23.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:23.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:24.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:24.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:24.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:24.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:25.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:25.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:25.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:25.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:26.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:26.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:26.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:26.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:27.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:27.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:27.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:27.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:28.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:28.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:28.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:28.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:29.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:29.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:29.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:29.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:30.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:30.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:30.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:30.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:31.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:31.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:31.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:31.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:32.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:32.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:32.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:32.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:33.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:33.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:33.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:33.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:34.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:34.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:34.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:34.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:35.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:35.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:35.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:35.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:36.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:36.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:36.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:36.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:37.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:37.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:37.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:37.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:38.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:38.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:38.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:38.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:39.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:39.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:39.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:39.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:40.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:40.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:40.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:40.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:41.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:41.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:41.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:41.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:42.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:42.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:42.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:42.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:43.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:43.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:43.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:43.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:44.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:44.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:44.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:44.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:45.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:45.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:45.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:45.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:46.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:46.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:46.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:46.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:47.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:47.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:47.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:47.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:48.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:48.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:48.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:48.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:49.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:49.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:49.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:49.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:50.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:50.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:50.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:50.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:51.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:51.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:51.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:51.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:52.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:52.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:52.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:52.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:53.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:53.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:53.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:53.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:54.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:54.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:54.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:54.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:55.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:55.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:55.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:55.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:56.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:56.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:56.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:56.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:57.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:57.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:57.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:57.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:58.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:58.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:58.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:58.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:59.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:19:59.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:19:59.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:19:59.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:00.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:00.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:00.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:00.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:01.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:01.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:01.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:01.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:02.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:02.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:02.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:02.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:03.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:03.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:03.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:03.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:04.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:04.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:04.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:04.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:05.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:05.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:05.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:05.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:06.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:06.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:06.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:06.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:07.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:07.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:07.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:07.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:08.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:08.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:08.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:08.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:09.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:09.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:09.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:09.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:10.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:10.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:10.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:10.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:11.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:11.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:11.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:11.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:12.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:12.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:12.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:12.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:13.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:13.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:13.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:13.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:14.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:14.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:14.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:14.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:15.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:15.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:15.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:15.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:16.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:16.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:16.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:16.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:17.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:17.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:17.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:17.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:18.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:18.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:18.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:18.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:19.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:19.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:19.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:19.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:20.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:20.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:20.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:20.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:21.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:21.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:21.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:21.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:22.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:22.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:22.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:22.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:23.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:23.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:23.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:23.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:24.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:24.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:24.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:24.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:25.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:25.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:25.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:25.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:26.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:26.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:26.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:26.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:27.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:27.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:27.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:27.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:28.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:28.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:28.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:28.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:29.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:29.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:29.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:29.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:30.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:30.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:30.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:30.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:31.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:31.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:31.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:31.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:32.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:32.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:32.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:32.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:33.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:33.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:33.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:33.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:34.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:34.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:34.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:34.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:35.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:35.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:35.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:35.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:36.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:36.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:36.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:36.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:37.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:37.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:37.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:37.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:38.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:38.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:38.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:38.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:39.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:39.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:39.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:39.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:40.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:40.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:40.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:40.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:41.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:41.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:41.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:41.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:42.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:42.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:42.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:42.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:43.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:43.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:43.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:43.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:44.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:44.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:44.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:44.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:45.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:45.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:45.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:45.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:46.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:46.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:46.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:46.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:47.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:47.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:47.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:47.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:48.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:48.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:48.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:48.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:49.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:49.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:49.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:49.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:50.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:50.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:50.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:50.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:51.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:51.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:51.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:51.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:52.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:52.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:52.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:52.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:53.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:53.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:53.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:53.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:54.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:54.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:54.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:54.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:55.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:55.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:55.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:55.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:56.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:56.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:56.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:56.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:57.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:57.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:57.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:57.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:58.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:58.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:58.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:58.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:59.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:20:59.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:20:59.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:20:59.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:00.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:00.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:00.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:00.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:01.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:01.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:01.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:01.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:02.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:02.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:02.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:02.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:03.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:03.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:03.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:03.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:04.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:04.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:04.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:04.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:05.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:05.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:05.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:05.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:06.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:06.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:06.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:06.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:07.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:07.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:07.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:07.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:08.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:08.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:08.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:08.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:09.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:09.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:09.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:09.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:10.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:10.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:10.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:10.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:11.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:11.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:11.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:11.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:12.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:12.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:12.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:12.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:13.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:13.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:13.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:13.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:14.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:14.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:14.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:14.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:15.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:15.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:15.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:15.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:16.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:16.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:16.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:16.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:17.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:17.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:17.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:17.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:18.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:18.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:18.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:18.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:19.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:19.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:19.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:19.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:20.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:20.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:20.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:20.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:21.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:21.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:21.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:21.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:22.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:22.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:22.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:22.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:23.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:23.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:23.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:23.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:24.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:24.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:24.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:24.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:25.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:25.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:25.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:25.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:26.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:26.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:26.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:26.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:27.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:27.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:27.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:27.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:28.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:28.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:28.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:28.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:29.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:29.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:29.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:29.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:30.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:30.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:30.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:30.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:31.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:31.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:31.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:31.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:32.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:32.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:32.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:32.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:33.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:33.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:33.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:33.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:34.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:34.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:34.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:34.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:35.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:35.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:35.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:35.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:36.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:36.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:36.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:36.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:37.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:37.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:37.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:37.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:38.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:38.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:38.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:38.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:39.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:39.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:39.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:39.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:40.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:40.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:40.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:40.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:41.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:41.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:41.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:41.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:42.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:42.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:42.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:42.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:43.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:43.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:43.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:43.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:44.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:44.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:44.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:44.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:45.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:45.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:45.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:45.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:46.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:46.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:46.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:46.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:47.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:47.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:47.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:47.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:48.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:48.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:48.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:48.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:49.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:49.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:49.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:49.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:50.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:50.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:50.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:50.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:51.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:51.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:51.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:51.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:52.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:52.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:52.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:52.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:53.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:53.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:53.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:53.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:54.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:54.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:54.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:54.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:55.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:55.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:55.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:55.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:56.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:56.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:56.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:56.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:57.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:57.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:57.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:57.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:58.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:58.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:58.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:58.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:59.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:21:59.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:21:59.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:21:59.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:00.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:00.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:00.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:00.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:01.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:01.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:01.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:01.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:02.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:02.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:02.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:02.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:03.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:03.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:03.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:03.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:04.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:04.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:04.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:04.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:05.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:05.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:05.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:05.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:06.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:06.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:06.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:06.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:07.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:07.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:07.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:07.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:08.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:08.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:08.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:08.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:09.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:09.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:09.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:09.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:10.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:10.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:10.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:10.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:11.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:11.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:11.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:11.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:12.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:12.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:12.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:12.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:13.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:13.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:13.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:13.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:14.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:14.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:14.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:14.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:15.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:15.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:15.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:15.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:16.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:16.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:16.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:16.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:17.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:17.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:17.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:17.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:18.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:18.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:18.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:18.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:19.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:19.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:19.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:19.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:20.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:20.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:20.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:20.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:21.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:21.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:21.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:21.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:22.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:22.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:22.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:22.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:23.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:23.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:23.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:23.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:24.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:24.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:24.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:24.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:25.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:25.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:25.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:25.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:26.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:26.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:26.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:26.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:27.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:27.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:27.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:27.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:28.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:28.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:28.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:28.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:29.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:29.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:29.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:29.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:30.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:30.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:30.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:30.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:31.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:31.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:31.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:31.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:32.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:32.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:32.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:32.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:33.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:33.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:33.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:33.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:34.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:34.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:34.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:34.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:35.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:35.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:35.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:35.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:36.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:36.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:36.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:36.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:37.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:37.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:37.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:37.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:38.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:38.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:38.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:38.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:39.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:39.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:39.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:39.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:40.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:40.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:40.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:40.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:41.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:41.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:41.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:41.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:42.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:42.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:42.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:42.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:43.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:43.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:43.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:43.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:44.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:44.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:44.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:44.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:45.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:45.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:45.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:45.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:46.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:46.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:46.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:46.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:47.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:47.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:47.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:47.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:48.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:48.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:48.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:48.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:49.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:49.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:49.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:49.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:50.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:50.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:50.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:50.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:51.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:51.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:51.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:51.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:52.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:52.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:52.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:52.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:53.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:53.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:53.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:53.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:54.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:54.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:54.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:54.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:55.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:55.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:55.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:55.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:56.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:56.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:56.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:56.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:57.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:57.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:57.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:57.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:58.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:58.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:58.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:58.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:59.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:22:59.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:22:59.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:22:59.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:00.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:00.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:00.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:00.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:01.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:01.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:01.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:01.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:02.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:02.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:02.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:02.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:03.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:03.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:03.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:03.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:04.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:04.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:04.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:04.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:05.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:05.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:05.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:05.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:06.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:06.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:06.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:06.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:07.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:07.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:07.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:07.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:08.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:08.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:08.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:08.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:09.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:09.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:09.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:09.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:10.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:10.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:10.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:10.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:11.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:11.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:11.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:11.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:12.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:12.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:12.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:12.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:13.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:13.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:13.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:13.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:14.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:14.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:14.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:14.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:15.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:15.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:15.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:15.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:16.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:16.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:16.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:16.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:17.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:17.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:17.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:17.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:18.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:18.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:18.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:18.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:19.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:19.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:19.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:19.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:20.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:20.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:20.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:20.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:21.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:21.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:21.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:21.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:22.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:22.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:22.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:22.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:23.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:23.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:23.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:23.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:24.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:24.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:24.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:24.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:25.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:25.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:25.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:25.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:26.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:26.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:26.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:26.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:27.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:27.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:27.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:27.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:28.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:28.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:28.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:28.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:29.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:29.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:29.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:29.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:30.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:30.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:30.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:30.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:31.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:31.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:31.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:31.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:32.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:32.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:32.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:32.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:33.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:33.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:33.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:33.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:34.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:34.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:34.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:34.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:35.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:35.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:35.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:35.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:36.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:36.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:36.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:36.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:37.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:37.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:37.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:37.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:38.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:38.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:38.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:38.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:39.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:39.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:39.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:39.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:40.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:40.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:40.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:40.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:41.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:41.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:41.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:41.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:42.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:42.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:42.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:42.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:43.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:43.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:43.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:43.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:44.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:44.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:44.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:44.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:45.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:45.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:45.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:45.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:46.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:46.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:46.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:46.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:47.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:47.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:47.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:47.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:48.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:48.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:48.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:48.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:49.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:49.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:49.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:49.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:50.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:50.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:50.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:50.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:51.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:51.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:51.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:51.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:52.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:52.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:52.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:52.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:53.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:53.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:53.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:53.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:54.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:54.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:54.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:54.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:55.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:55.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:55.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:55.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:56.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:56.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:56.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:56.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:57.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:57.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:57.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:57.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:58.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:58.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:58.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:58.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:59.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:23:59.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:23:59.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:23:59.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:00.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:00.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:00.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:00.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:01.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:01.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:01.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:01.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:02.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:02.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:02.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:02.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:03.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:03.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:03.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:03.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:04.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:04.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:04.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:04.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:05.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:05.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:05.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:05.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:06.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:06.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:06.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:06.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:07.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:07.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:07.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:07.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:08.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:08.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:08.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:08.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:09.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:09.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:09.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:09.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:10.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:10.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:10.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:10.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:11.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:11.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:11.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:11.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:12.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:12.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:12.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:12.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:13.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:13.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:13.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:13.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:14.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:14.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:14.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:14.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:15.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:15.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:15.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:15.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:16.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:16.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:16.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:16.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:17.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:17.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:17.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:17.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:18.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:18.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:18.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:18.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:19.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:19.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:19.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:19.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:20.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:20.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:20.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:20.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:21.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:21.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:21.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:21.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:22.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:22.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:22.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:22.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:23.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:23.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:23.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:23.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:24.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:24.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:24.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:24.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:25.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:25.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:25.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:25.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:26.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:26.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:26.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:26.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:27.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:27.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:27.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:27.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:28.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:28.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:28.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:28.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:29.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:29.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:29.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:29.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:30.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:30.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:30.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:30.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:31.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:31.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:31.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:31.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:32.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:32.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:32.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:32.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:33.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:33.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:33.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:33.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:34.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:34.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:34.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:34.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:35.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:35.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:35.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:35.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:36.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:36.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:36.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:36.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:37.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:37.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:37.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:37.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:38.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:38.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:38.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:38.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:39.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:39.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:39.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:39.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:40.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:40.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:40.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:40.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:41.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:41.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:41.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:41.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:42.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:42.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:42.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:42.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:43.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:43.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:43.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:43.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:44.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:44.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:44.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:44.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:45.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:45.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:45.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:45.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:46.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:46.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:46.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:46.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:47.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:47.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:47.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:47.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:48.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:48.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:48.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:48.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:49.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:49.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:49.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:49.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:50.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:50.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:50.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:50.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:51.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:51.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:51.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:51.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:52.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:52.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:52.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:52.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:53.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:53.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:53.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:53.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:54.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:54.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:54.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:54.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:55.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:55.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:55.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:55.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:56.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:56.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:56.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:56.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:57.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:57.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:57.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:57.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:58.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:58.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:58.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:58.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:59.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:24:59.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:24:59.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:24:59.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:00.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:00.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:00.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:00.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:01.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:01.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:01.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:01.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:02.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:02.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:02.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:02.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:02.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:03.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:03.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:03.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:03.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:03.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:04.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:04.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:04.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:04.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:05.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:05.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:05.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:05.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:06.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:06.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:06.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:06.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:07.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:07.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:07.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:07.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:08.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:08.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:08.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:08.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:09.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:09.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:09.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:09.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:10.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:10.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:11.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:11.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:11.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:11.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:12.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:12.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:12.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:12.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:13.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:13.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:13.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:13.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:13.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:13.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:14.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:14.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:14.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:14.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:15.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:15.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:15.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:15.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:16.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:16.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:16.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:16.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:17.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:17.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:17.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:17.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:18.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:18.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:18.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:18.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:19.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:19.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:19.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:19.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:20.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:20.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:20.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:20.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:21.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:21.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:21.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:21.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:22.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:22.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:22.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:22.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:23.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:23.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:23.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:23.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:24.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:24.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:24.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:24.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:25.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:25.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:25.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:25.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:26.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:26.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:26.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:26.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:27.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:27.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:27.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:27.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:28.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:28.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:28.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:28.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:29.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:29.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:29.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:29.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:30.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:30.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:30.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:30.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:31.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:31.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:31.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:31.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:32.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:32.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:32.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:32.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:33.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:33.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:33.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:33.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:34.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:34.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:34.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:34.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:35.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:35.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:35.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:35.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:36.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:36.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:36.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:36.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:37.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:37.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:37.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:37.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:38.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:38.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:38.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:38.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:39.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:39.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:39.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:39.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:40.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:40.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:41.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:41.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:41.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:41.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:42.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:42.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:42.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:42.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:43.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:43.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:43.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:43.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:44.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:44.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:44.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:44.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:45.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:45.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:45.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:45.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:46.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:46.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:46.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:46.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:47.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:47.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:47.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:47.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:48.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:48.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:48.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:48.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:49.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:49.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:49.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:49.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:50.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:50.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:50.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:50.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:51.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:51.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:51.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:51.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:52.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:52.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:52.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:52.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:53.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:53.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:53.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:53.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:54.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:54.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:54.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:54.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:55.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:55.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:55.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:55.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:56.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:56.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:56.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:56.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:57.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:57.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:57.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:57.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:58.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:58.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:58.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:58.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:59.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:25:59.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:25:59.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:25:59.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:00.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:00.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:00.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:00.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:01.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:01.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:01.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:01.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:02.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:02.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:02.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:02.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:03.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:03.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:03.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:03.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:04.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:04.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:04.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:04.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:05.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:05.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:05.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:05.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:06.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:06.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:06.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:06.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:07.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:07.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:07.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:07.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:08.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:08.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:08.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:08.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:09.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:09.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:09.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:09.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:10.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:10.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:10.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:10.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:11.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:11.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:11.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:11.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:12.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:12.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:12.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:12.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:13.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:13.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:13.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:13.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:14.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:14.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:14.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:14.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:15.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:15.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:15.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:15.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:16.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:16.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:16.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:16.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:16.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:16.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:17.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:17.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:17.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:17.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:18.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:18.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:18.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:18.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:19.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:19.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:19.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:19.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:20.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:20.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:20.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:20.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:21.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:21.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:21.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:21.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:22.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:22.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:22.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:22.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:23.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:23.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:23.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:23.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:24.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:24.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:24.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:24.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:25.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:25.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:25.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:25.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:26.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:26.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:26.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:26.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:27.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:27.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:27.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:27.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:28.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:28.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:28.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:28.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:29.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:29.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:29.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:29.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:30.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:30.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:30.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:30.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:31.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:31.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:32.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:32.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:32.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:32.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:32.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:32.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:33.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:33.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:33.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:33.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:34.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:34.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:34.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:34.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:35.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:35.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:35.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:35.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:36.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:36.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:36.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:36.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:37.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:37.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:37.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:37.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:38.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:38.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:38.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:38.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:39.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:39.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:39.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:39.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:40.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:40.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:40.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:40.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:41.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:41.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:41.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:41.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:42.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:42.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:42.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:42.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:43.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:43.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:43.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:43.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:44.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:44.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:44.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:44.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:45.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:45.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:45.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:45.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:46.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:46.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:46.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:46.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:47.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:47.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:47.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:47.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:48.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:48.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:48.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:48.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:48.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:49.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:49.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:49.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:49.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:49.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:50.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:50.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:50.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:50.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:51.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:51.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:51.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:51.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:52.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:52.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:52.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:52.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:53.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:53.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:53.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:53.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:54.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:54.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:54.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:54.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:55.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:55.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:55.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:55.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:56.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:56.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:57.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:57.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:57.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:57.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:57.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:57.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:58.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:58.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:58.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:58.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:59.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:26:59.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:26:59.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:26:59.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:00.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:00.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:00.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:00.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:01.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:01.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:01.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:01.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:02.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:02.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:02.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:02.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:03.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:03.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:03.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:03.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:04.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:04.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:04.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:04.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:05.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:05.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:05.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:05.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:06.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:06.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:07.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:07.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:07.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:07.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:08.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:08.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:08.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:08.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:09.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:09.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:09.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:09.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:10.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:10.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:10.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:10.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:11.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:11.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:11.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:11.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:12.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:12.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:12.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:12.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:13.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:13.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:13.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:13.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:14.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:14.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:14.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:14.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:15.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:15.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:15.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:15.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:16.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:16.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:16.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:16.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:17.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:17.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:17.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:17.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:17.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:17.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:18.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:18.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:18.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:18.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:19.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:19.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:19.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:19.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:20.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:20.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:20.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:20.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:21.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:21.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:21.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:21.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:22.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:22.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:22.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:22.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:23.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:23.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:23.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:23.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:24.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:24.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:24.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:24.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:25.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:25.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:25.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:25.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:26.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:26.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:26.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:26.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:27.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:27.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:27.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:27.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:28.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:28.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:28.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:28.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:29.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:29.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:29.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:29.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:30.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:30.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:30.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:30.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:31.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:31.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:31.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:31.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:32.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:32.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:32.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:32.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:33.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:33.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:33.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:33.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:34.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:34.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:35.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:35.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:35.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:35.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:36.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:36.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:36.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:36.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:36.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:36.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:37.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:37.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:37.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:37.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:38.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:38.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:38.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:39.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:39.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:39.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:40.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:40.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:40.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:40.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:41.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:41.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:41.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:41.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:42.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:42.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:42.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:42.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:43.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:43.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:43.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:43.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:44.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:44.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:44.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:44.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:45.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:45.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:45.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:45.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:46.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:46.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:46.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:46.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:47.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:47.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:47.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:47.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:48.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:48.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:48.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:48.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:49.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:49.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:49.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:49.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:49.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:49.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:50.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:50.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:50.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:50.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:51.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:51.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:52.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:52.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:52.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:52.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:53.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:53.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:53.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:53.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:54.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:54.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:54.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:54.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:54.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:54.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:55.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:55.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:55.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:55.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:56.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:56.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:56.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:56.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:57.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:57.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:57.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:57.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:58.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:58.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:59.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:27:59.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:27:59.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:27:59.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:00.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:00.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:00.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:00.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:01.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:01.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:01.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:01.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:02.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:02.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:02.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:02.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:03.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:03.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:03.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:03.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:04.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:04.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:04.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:04.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:05.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:05.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:05.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:05.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:06.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:06.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:06.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:06.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:07.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:07.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:07.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:07.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:08.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:08.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:08.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:08.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:09.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:09.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:09.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:09.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:10.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:10.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:10.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:10.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:11.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:11.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:11.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:11.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:12.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:12.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:13.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:13.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:13.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:13.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:13.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:13.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:14.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:14.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:14.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:14.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:15.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:15.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:15.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:15.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:16.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:16.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:16.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:16.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:17.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:17.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:17.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:17.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:18.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:18.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:18.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:18.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:19.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:19.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:19.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:19.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:20.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:20.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:20.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:20.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:21.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:21.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:21.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:21.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:22.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:22.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:23.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:23.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:23.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:23.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:24.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:24.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:24.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:24.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:25.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:25.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:25.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:25.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:26.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:26.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:26.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:26.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:27.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:27.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:27.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:27.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:28.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:28.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:28.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:28.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:29.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:29.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:29.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:29.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:30.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:30.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:30.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:30.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:31.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:31.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:31.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:31.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:32.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:32.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:32.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:32.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:33.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:33.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:33.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:33.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:34.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:34.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:34.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:34.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:35.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:35.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:35.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:35.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:36.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:36.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:36.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:36.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:37.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:37.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:37.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:37.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:38.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:38.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:38.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:38.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:38.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:38.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:39.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:39.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:40.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:40.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:40.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:40.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:41.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:41.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:41.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:41.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:42.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:42.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:42.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:42.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:43.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:43.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:43.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:43.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:44.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:44.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:44.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:44.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:45.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:45.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:45.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:45.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:45.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:45.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:46.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:46.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:46.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:46.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:47.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:47.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:47.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:47.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:48.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:48.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:49.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:49.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:49.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:49.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:49.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:49.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:50.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:50.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:51.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:51.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:51.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:51.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:52.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:52.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:52.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:52.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:53.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:53.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:53.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:53.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:54.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:54.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:54.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:54.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:55.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:55.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:55.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:55.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:56.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:56.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:56.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:56.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:57.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:57.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:57.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:57.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:58.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:58.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:58.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:58.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:59.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:28:59.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:28:59.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:28:59.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:00.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:00.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:00.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:00.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:01.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:01.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:01.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:01.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:02.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:02.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:02.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:02.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:03.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:03.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:03.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:03.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:04.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:04.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:04.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:04.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:05.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:05.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:05.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:05.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:06.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:06.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:06.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:06.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:07.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:07.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:07.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:07.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:08.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:08.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:08.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:08.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:09.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:09.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:09.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:09.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:10.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:10.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:10.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:10.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:11.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:11.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:11.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:11.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:12.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:12.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:12.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:12.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:13.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:13.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:13.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:13.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:14.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:14.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:14.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:14.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:15.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:15.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:15.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:15.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:16.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:16.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:16.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:16.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:17.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:17.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:17.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:17.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:18.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:18.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:18.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:18.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:19.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:19.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:19.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:19.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:20.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:20.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:20.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:20.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:21.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:21.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:21.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:21.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:22.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:22.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:22.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:22.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:23.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:23.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:23.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:23.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:24.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:24.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:24.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:24.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:25.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:25.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:25.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:25.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:26.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:26.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:26.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:26.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:27.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:27.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:27.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:27.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:28.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:28.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:28.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:28.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:29.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:29.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:29.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:29.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:30.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:30.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:30.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:30.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:31.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:31.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:31.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:31.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:32.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:32.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:32.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:32.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:33.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:33.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:33.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:33.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:34.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:34.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:34.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:34.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:35.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:35.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:35.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:35.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:36.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:36.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:36.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:36.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:37.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:37.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:37.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:37.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:38.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:38.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:38.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:38.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:39.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:39.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:39.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:39.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:40.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:40.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:40.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:40.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:41.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:41.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:41.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:41.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:42.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:42.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:42.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:42.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:43.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:43.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:43.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:43.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:44.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:44.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:44.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:44.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:45.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:45.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:45.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:45.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:46.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:46.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:46.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:46.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:47.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:47.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:47.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:47.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:48.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:48.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:48.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:48.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:49.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:49.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:49.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:49.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:50.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:50.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:50.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:50.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:51.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:51.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:51.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:51.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:52.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:52.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:52.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:52.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:53.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:53.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:53.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:53.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:54.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:54.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:54.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:54.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:55.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:55.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:55.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:55.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:56.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:56.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:56.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:56.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:57.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:57.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:57.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:57.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:58.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:58.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:59.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:29:59.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:29:59.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:29:59.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:00.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:00.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:00.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:00.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:00.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:00.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:01.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:01.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:01.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:01.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:02.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:02.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:02.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:02.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:03.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:03.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:03.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:03.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:04.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:04.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:04.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:04.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:05.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:05.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:05.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:05.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:06.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:06.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:06.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:06.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:07.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:07.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:07.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:07.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:08.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:08.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:08.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:08.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:09.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:09.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:09.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:09.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:10.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:10.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:10.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:10.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:11.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:11.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:11.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:11.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:12.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:12.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:12.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:12.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:13.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:13.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:13.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:13.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:14.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:14.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:14.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:14.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:15.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:15.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:15.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:15.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:16.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:16.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:16.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:16.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:17.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:17.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:18.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:18.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:18.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:18.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:18.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:18.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:19.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:19.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:19.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:19.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:20.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:20.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:20.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:20.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:21.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:21.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:21.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:21.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:22.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:22.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:22.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:22.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:23.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:23.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:23.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:23.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:24.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:24.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:24.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:24.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:25.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:25.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:25.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:25.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:26.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:26.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:26.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:26.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:27.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:27.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:27.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:27.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:28.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:28.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:28.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:28.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:29.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:29.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:29.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:29.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:30.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:30.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:30.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:30.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:31.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:31.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:31.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:31.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:32.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:32.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:32.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:32.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:33.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:33.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:33.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:33.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:34.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:34.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:34.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:34.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:35.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:35.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:35.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:35.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:36.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:36.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:36.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:36.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:37.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:37.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:37.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:37.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:38.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:38.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:38.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:38.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:39.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:39.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:39.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:39.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:40.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:40.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:40.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:40.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:41.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:41.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:41.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:41.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:42.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:42.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:42.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:42.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:43.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:43.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:43.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:43.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:44.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:44.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:44.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:44.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:45.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:45.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:45.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:45.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:46.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:46.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:46.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:46.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:47.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:47.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:47.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:47.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:48.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:48.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:48.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:48.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:49.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:49.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:49.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:49.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:50.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:50.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:50.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:50.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:51.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:51.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:51.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:51.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:52.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:52.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:52.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:52.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:53.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:53.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:53.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:53.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:54.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:54.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:54.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:54.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:55.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:55.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:55.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:55.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:56.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:56.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:56.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:56.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:57.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:57.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:57.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:57.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:58.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:58.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:58.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:58.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:59.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:30:59.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:30:59.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:30:59.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:00.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:00.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:00.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:00.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:01.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:01.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:01.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:01.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:02.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:02.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:02.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:02.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:03.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:03.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:03.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:03.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:04.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:04.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:04.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:04.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:05.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:05.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:05.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:05.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:06.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:06.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:06.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:06.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:07.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:07.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:07.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:07.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:08.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:08.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:08.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:08.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:09.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:09.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:09.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:09.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:10.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:10.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:10.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:10.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:11.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:11.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:11.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:11.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:12.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:12.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:12.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:12.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:13.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:13.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:13.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:13.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:14.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:14.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:14.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:14.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:15.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:15.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:15.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:15.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:16.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:16.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:16.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:16.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:17.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:17.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:17.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:17.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:18.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:18.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:18.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:18.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:19.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:19.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:19.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:19.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:20.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:20.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:20.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:20.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:21.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:21.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:21.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:21.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:22.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:22.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:22.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:22.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:23.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:23.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:23.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:23.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:24.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:24.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:24.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:24.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:25.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:25.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:25.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:25.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:26.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:26.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:26.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:26.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:27.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:27.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:27.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:27.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:28.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:28.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:28.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:28.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:29.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:29.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:29.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:29.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:30.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:30.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:30.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:30.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:31.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:31.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:31.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:31.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:32.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:32.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:32.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:32.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:33.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:33.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:33.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:33.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:34.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:34.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:34.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:34.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:35.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:35.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:35.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:35.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:36.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:36.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:36.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:36.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:37.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:37.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:37.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:37.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:38.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:38.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:38.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:38.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:39.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:39.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:39.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:39.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:40.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:40.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:40.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:40.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:41.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:41.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:41.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:41.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:42.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:42.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:42.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:42.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:43.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:43.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:43.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:43.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:44.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:44.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:44.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:44.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:45.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:45.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:45.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:45.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:46.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:46.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:46.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:46.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:47.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:47.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:47.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:47.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:48.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:48.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:48.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:48.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:49.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:49.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:49.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:49.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:50.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:50.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:50.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:50.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:51.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:51.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:51.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:51.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:52.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:52.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:52.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:52.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:53.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:53.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:53.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:53.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:54.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:54.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:54.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:54.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:55.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:55.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:55.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:55.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:56.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:56.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:56.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:56.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:57.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:57.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:57.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:57.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:58.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:58.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:58.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:58.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:59.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:31:59.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:31:59.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:31:59.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:00.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:00.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:00.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:00.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:01.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:01.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:01.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:01.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:02.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:02.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:02.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:02.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:03.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:03.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:03.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:03.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:04.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:04.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:04.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:04.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:05.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:05.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:05.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:05.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:06.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:06.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:06.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:06.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:07.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:07.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:07.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:07.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:08.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:08.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:08.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:08.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:09.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:09.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:09.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:09.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:10.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:10.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:10.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:10.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:11.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:11.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:11.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:11.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:12.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:12.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:12.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:12.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:13.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:13.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:13.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:13.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:14.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:14.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:14.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:14.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:15.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:15.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:15.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:15.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:16.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:16.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:16.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:16.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:17.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:17.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:17.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:17.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:18.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:18.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:18.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:18.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:19.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:19.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:19.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:19.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:20.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:20.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:20.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:20.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:21.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:21.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:21.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:21.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:22.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:22.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:22.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:22.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:23.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:23.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:23.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:23.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:24.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:24.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:24.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:24.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:25.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:25.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:25.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:25.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:26.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:26.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:26.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:26.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:27.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:27.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:27.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:27.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:28.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:28.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:28.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:28.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:29.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:29.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:29.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:29.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:30.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:30.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:30.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:30.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:31.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:31.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:31.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:31.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:32.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:32.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:32.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:32.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:33.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:33.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:33.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:33.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:34.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:34.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:34.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:34.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:35.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:35.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:35.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:35.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:36.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:36.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:36.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:36.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:37.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:37.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:37.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:37.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:38.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:38.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:38.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:38.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:39.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:39.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:39.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:39.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:40.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:40.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:40.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:40.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:41.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:41.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:41.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:41.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:42.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:42.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:42.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:42.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:43.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:43.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:43.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:43.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:44.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:44.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:44.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:44.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:45.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:45.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:45.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:45.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:46.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:46.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:46.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:46.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:47.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:47.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:47.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:47.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:48.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:48.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:48.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:48.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:49.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:49.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:49.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:49.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:50.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:50.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:50.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:50.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:51.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:51.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:51.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:51.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:52.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:52.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:52.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:52.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:53.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:53.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:53.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:53.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:54.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:54.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:54.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:54.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:55.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:55.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:55.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:55.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:56.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:56.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:56.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:56.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:57.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:57.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:57.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:57.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:58.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:58.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:58.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:58.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:59.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:32:59.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:32:59.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:32:59.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:00.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:00.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:00.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:00.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:01.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:01.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:01.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:01.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:02.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:02.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:02.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:02.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:03.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:03.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:03.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:03.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:04.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:04.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:04.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:04.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:05.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:05.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:05.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:05.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:06.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:06.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:06.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:06.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:07.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:07.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:08.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:07.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:08.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:08.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:08.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:08.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:09.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:09.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:09.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:09.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:10.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:10.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:10.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:10.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:11.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:11.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:11.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:11.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:12.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:12.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:12.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:12.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:13.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:13.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:13.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:13.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:14.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:14.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:14.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:14.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:15.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:15.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:15.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:15.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:16.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:16.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:16.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:16.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:17.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:17.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:17.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:17.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:18.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:18.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:18.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:18.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:19.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:19.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:19.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:19.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:20.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:20.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:20.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:20.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:21.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:21.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:21.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:21.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:22.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:22.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:22.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:22.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:23.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:23.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:23.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:23.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:24.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:24.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:24.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:24.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:25.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:25.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:25.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:25.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:26.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:26.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:26.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:26.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:27.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:27.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:27.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:27.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:28.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:28.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:28.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:28.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:29.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:29.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:29.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:29.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:30.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:30.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:30.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:30.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:31.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:31.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:31.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:31.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:32.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:32.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:32.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:32.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:33.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:33.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:33.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:33.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:34.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:34.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:34.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:34.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:35.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:35.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:35.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:35.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:36.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:36.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:36.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:36.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:37.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:37.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:38.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:38.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:38.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:38.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:38.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:38.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:39.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:39.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:39.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:39.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:40.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:40.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:40.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:40.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:41.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:41.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:41.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:41.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:42.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:42.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:43.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:43.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:43.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:43.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:43.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:43.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:44.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:44.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:45.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:45.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:45.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:45.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:46.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:46.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:46.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:46.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:46.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:47.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:47.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:47.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:47.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:47.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:48.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:48.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:48.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:48.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:49.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:49.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:49.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:49.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:50.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:50.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:50.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:50.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:51.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:51.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:51.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:51.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:52.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:52.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:52.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:52.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:53.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:53.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:53.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:53.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:54.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:54.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:54.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:54.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:55.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:55.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:55.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:55.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:56.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:56.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:56.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:57.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:57.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:57.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:57.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:58.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:58.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:58.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:58.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:59.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:59.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:33:59.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:33:59.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:33:59.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:00.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:00.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:01.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:01.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:01.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:01.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:01.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:02.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:02.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:02.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:03.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:03.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:03.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:03.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:04.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:04.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:04.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:04.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:05.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:05.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:05.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:05.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:06.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:06.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:06.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:06.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:07.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:07.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:07.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:07.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:08.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:08.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:08.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:08.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:09.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:09.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:09.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:09.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:10.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:10.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:10.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:10.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:11.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:11.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:11.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:11.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:12.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:12.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:12.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:12.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:13.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:13.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:13.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:13.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:14.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:14.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:14.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:14.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:15.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:15.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:15.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:15.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:16.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:16.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:16.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:16.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:17.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:17.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:17.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:17.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:18.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:18.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:18.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:18.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:19.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:19.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:19.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:19.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:20.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:20.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:20.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:20.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:21.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:21.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:21.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:21.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:22.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:22.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:22.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:22.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:23.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:23.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:23.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:23.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:24.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:24.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:24.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:24.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:25.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:25.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:25.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:25.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:26.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:26.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:26.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:26.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:27.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:27.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:27.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:27.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:28.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:28.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:28.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:28.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:29.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:29.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:29.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:29.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:30.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:30.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:30.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:30.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:31.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:31.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:31.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:31.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:32.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:32.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:32.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:32.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:33.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:33.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:33.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:33.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:34.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:34.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:34.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:34.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:35.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:35.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:35.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:35.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:36.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:36.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:36.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:36.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:37.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:37.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:37.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:37.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:38.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:38.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:38.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:38.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:39.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:39.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:39.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:39.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:40.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:40.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:40.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:40.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:41.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:41.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:41.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:41.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:42.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:42.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:42.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:42.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:43.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:43.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:43.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:43.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:44.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:44.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:44.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:44.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:45.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:45.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:45.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:45.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:46.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:46.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:46.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:46.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:47.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:47.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:47.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:47.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:48.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:48.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:48.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:48.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:49.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:49.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:49.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:49.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:50.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:50.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:50.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:50.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:51.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:51.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:51.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:51.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:52.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:52.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:52.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:52.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:53.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:53.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:53.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:53.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:54.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:54.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:54.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:54.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:55.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:55.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:55.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:55.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:56.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:56.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:56.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:56.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:57.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:57.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:57.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:57.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:58.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:58.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:58.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:58.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:59.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:34:59.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:34:59.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:34:59.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:00.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:00.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:00.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:00.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:01.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:01.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:01.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:01.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:02.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:02.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:02.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:02.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:03.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:03.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:03.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:03.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:04.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:04.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:04.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:04.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:05.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:05.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:05.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:05.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:06.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:06.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:06.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:06.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:07.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:07.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:07.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:07.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:08.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:08.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:08.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:08.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:09.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:09.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:09.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:09.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:10.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:10.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:10.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:10.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:11.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:11.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:11.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:11.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:12.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:12.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:12.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:12.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:13.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:13.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:13.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:13.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:14.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:14.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:14.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:14.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:15.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:15.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:15.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:15.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:16.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:16.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:16.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:16.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:17.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:17.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:17.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:17.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:18.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:18.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:18.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:18.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:19.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:19.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:20.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:20.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:20.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:20.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:21.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:21.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:21.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:21.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:22.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:22.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:22.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:22.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:23.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:23.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:23.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:23.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:24.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:24.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:24.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:24.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:25.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:25.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:25.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:25.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:26.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:26.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:26.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:26.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:27.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:27.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:27.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:27.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:28.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:28.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:28.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:28.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:29.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:29.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:29.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:29.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:30.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:30.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:30.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:30.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:31.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:31.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:31.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:31.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:32.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:32.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:32.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:32.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:33.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:33.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:33.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:33.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:34.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:34.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:34.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:34.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:35.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:35.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:35.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:35.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:36.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:36.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:36.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:36.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:37.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:37.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:37.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:37.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:38.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:38.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:38.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:38.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:39.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:39.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:39.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:39.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:40.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:40.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:40.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:40.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:41.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:41.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:41.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:41.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:42.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:42.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:42.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:42.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:43.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:43.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:43.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:43.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:44.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:44.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:44.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:44.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:45.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:45.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:45.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:45.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:46.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:46.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:46.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:46.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:47.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:47.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:47.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:47.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:47.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:47.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:48.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:48.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:49.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:49.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:49.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:49.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:49.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:49.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:50.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:50.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:50.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:50.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:51.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:51.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:51.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:52.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:52.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:52.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:53.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:53.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:53.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:53.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:54.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:54.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:54.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:54.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:55.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:55.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:55.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:55.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:56.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:56.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:56.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:56.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:57.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:57.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:57.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:57.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:58.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:58.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:58.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:58.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:59.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:59.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:59.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:35:59.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:35:59.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:35:59.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:00.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:00.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:01.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:01.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:01.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:01.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:02.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:02.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:02.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:02.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:03.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:03.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:03.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:03.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:04.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:04.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:04.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:04.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:05.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:05.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:05.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:05.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:05.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:05.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:06.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:06.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:07.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:07.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:07.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:07.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:07.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:07.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:08.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:08.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:08.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:08.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:09.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:09.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:09.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:09.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:10.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:10.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:10.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:10.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:11.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:11.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:11.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:11.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:12.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:12.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:12.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:12.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:13.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:13.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:13.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:13.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:14.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:14.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:14.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:14.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:15.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:15.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:15.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:15.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:16.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:16.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:16.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:16.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:17.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:17.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:17.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:17.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:18.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:18.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:18.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:18.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:19.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:19.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:19.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:19.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:20.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:20.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:20.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:20.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:21.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:21.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:21.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:21.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:22.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:22.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:22.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:22.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:23.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:23.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:23.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:23.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:24.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:24.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:24.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:24.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:25.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:25.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:25.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:25.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:26.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:26.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:26.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:26.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:27.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:27.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:27.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:27.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:28.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:28.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:28.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:28.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:29.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:29.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:29.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:29.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:30.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:30.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:30.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:30.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:31.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:31.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:31.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:31.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:32.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:32.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:32.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:32.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:33.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:33.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:33.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:33.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:34.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:34.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:34.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:34.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:35.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:35.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:35.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:35.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:36.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:36.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:36.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:36.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:37.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:37.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:37.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:37.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:38.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:38.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:38.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:38.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:39.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:39.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:39.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:39.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:40.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:40.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:40.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:40.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:41.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:41.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:41.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:41.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:42.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:42.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:42.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:42.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:43.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:43.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:43.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:43.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:44.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:44.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:44.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:44.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:45.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:45.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:45.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:45.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:46.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:46.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:46.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:46.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:47.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:47.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:47.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:47.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:48.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:48.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:48.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:48.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:49.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:49.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:49.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:49.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:50.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:50.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:50.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:50.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:51.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:51.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:51.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:51.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:52.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:52.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:52.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:52.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:53.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:53.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:53.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:53.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:54.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:54.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:54.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:54.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:55.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:55.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:55.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:55.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:56.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:56.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:56.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:56.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:57.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:57.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:57.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:57.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:58.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:58.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:58.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:58.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:59.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:36:59.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:36:59.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:36:59.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:00.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:00.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:00.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:00.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:01.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:01.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:01.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:01.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:02.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:02.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:02.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:02.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:03.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:03.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:03.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:03.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:04.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:04.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:04.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:04.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:05.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:05.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:05.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:05.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:06.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:06.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:06.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:06.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:07.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:07.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:07.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:07.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:08.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:08.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:08.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:08.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:09.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:09.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:09.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:09.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:10.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:10.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:10.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:10.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:11.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:11.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:11.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:11.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:12.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:12.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:12.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:12.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:13.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:13.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:13.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:13.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:14.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:14.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:14.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:14.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:15.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:15.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:15.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:15.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:16.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:16.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:16.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:16.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:17.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:17.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:17.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:17.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:18.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:18.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:18.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:18.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:19.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:19.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:19.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:19.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:20.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:20.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:20.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:20.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:21.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:21.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:21.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:21.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:22.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:22.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:22.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:22.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:23.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:23.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:23.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:23.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:24.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:24.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:24.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:24.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:25.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:25.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:25.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:25.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:26.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:26.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:26.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:26.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:27.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:27.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:27.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:27.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:28.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:28.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:28.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:28.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:29.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:29.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:29.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:29.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:30.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:30.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:30.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:30.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:31.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:31.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:31.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:31.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:32.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:32.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:32.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:32.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:33.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:33.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:33.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:33.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:34.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:34.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:34.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:34.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:35.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:35.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:35.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:35.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:36.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:36.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:36.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:36.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:37.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:37.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:37.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:37.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:38.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:38.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:38.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:38.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:39.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:39.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:39.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:39.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:40.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:40.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:40.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:40.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:41.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:41.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:41.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:41.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:42.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:42.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:42.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:42.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:43.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:43.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:43.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:43.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:44.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:44.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:44.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:44.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:45.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:45.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:45.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:45.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:46.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:46.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:46.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:46.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:47.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:47.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:47.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:47.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:48.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:48.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:48.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:48.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:49.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:49.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:49.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:49.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:50.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:50.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:50.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:50.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:51.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:51.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:51.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:51.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:52.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:52.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:52.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:52.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:53.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:53.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:53.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:53.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:54.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:54.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:54.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:54.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:55.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:55.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:55.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:55.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:56.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:56.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:56.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:56.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:57.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:57.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:57.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:57.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:58.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:58.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:58.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:58.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:59.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:37:59.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:37:59.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:37:59.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:00.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:00.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:00.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:00.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:01.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:01.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:01.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:01.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:02.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:02.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:02.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:02.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:03.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:03.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:03.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:03.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:04.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:04.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:04.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:04.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:05.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:05.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:05.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:05.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:06.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:06.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:06.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:06.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:07.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:07.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:07.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:07.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:08.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:08.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:08.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:08.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:09.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:09.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:09.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:09.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:10.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:10.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:10.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:10.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:11.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:11.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:11.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:11.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:12.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:12.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:12.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:12.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:13.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:13.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:13.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:13.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:14.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:14.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:14.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:14.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:15.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:15.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:15.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:15.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:16.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:16.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:16.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:16.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:17.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:17.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:17.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:17.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:18.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:18.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:18.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:18.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:19.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:19.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:19.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:19.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:20.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:20.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:20.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:20.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:21.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:21.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:21.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:21.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:22.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:22.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:22.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:22.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:23.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:23.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:23.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:23.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:24.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:24.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:24.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:24.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:25.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:25.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:25.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:25.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:26.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:26.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:26.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:26.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:27.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:27.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:27.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:27.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:28.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:28.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:28.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:28.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:29.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:29.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:29.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:29.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:30.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:30.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:30.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:30.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:31.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:31.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:31.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:31.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:32.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:32.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:32.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:32.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:33.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:33.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:33.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:33.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:34.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:34.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:34.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:34.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:35.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:35.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:35.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:35.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:36.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:36.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:36.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:36.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:37.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:37.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:37.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:37.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:38.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:38.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:38.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:38.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:39.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:39.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:39.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:39.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:40.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:40.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:40.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:40.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:41.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:41.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:41.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:41.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:42.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:42.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:42.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:42.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:43.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:43.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:43.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:43.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:44.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:44.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:44.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:44.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:45.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:45.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:45.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:45.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:46.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:46.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:46.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:46.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:47.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:47.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:47.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:47.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:48.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:48.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:48.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:48.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:49.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:49.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:49.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:49.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:50.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:50.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:50.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:50.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:51.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:51.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:51.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:51.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:52.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:52.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:52.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:52.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:53.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:53.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:53.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:53.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:54.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:54.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:54.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:54.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:55.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:55.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:55.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:55.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:56.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:56.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:56.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:56.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:57.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:57.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:57.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:57.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:58.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:58.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:58.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:58.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:59.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:38:59.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:38:59.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:38:59.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:00.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:00.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:00.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:00.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:01.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:01.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:01.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:01.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:02.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:02.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:02.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:02.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:03.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:03.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:03.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:03.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:04.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:04.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:04.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:04.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:05.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:05.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:05.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:05.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:06.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:06.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:06.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:06.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:07.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:07.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:07.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:07.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:08.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:08.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:08.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:08.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:09.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:09.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:09.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:09.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:10.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:10.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:10.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:10.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:11.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:11.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:11.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:11.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:12.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:12.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:12.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:12.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:13.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:13.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:13.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:13.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:14.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:14.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:14.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:14.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:15.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:15.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:15.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:15.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:16.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:16.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:17.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:17.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:17.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:17.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:18.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:18.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:18.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:18.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:19.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:19.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:19.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:19.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:20.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:20.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:20.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:20.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:21.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:21.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:21.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:21.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:22.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:22.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:22.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:22.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:23.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:23.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:23.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:23.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:24.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:24.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:24.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:24.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:25.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:25.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:25.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:25.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:26.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:26.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:26.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:26.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:27.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:27.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:27.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:27.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:28.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:28.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:28.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:28.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:29.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:29.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:29.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:29.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:30.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:30.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:30.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:30.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:31.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:31.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:31.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:31.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:32.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:32.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:32.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:32.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:33.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:33.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:33.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:33.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:34.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:34.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:34.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:34.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:35.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:35.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:35.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:35.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:36.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:36.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:36.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:36.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:37.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:37.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:37.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:37.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:38.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:38.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:38.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:38.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:39.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:39.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:39.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:39.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:40.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:40.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:40.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:40.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:41.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:41.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:41.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:41.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:42.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:42.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:42.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:42.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:43.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:43.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:43.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:43.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:44.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:44.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:44.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:44.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:45.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:45.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:45.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:45.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:46.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:46.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:46.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:46.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:47.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:47.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:47.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:47.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:48.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:48.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:48.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:48.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:49.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:49.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:49.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:49.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:50.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:50.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:50.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:50.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:51.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:51.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:51.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:51.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:52.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:52.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:52.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:52.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:53.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:53.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:53.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:53.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:54.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:54.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:54.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:54.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:55.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:55.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:55.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:55.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:56.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:56.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:56.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:56.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:57.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:57.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:57.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:57.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:58.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:58.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:58.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:39:58.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:59.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:39:59.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:39:59.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:00.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:00.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:00.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:01.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:01.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:01.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:01.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:01.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:01.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:02.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:02.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:02.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:02.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:03.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:03.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:03.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:03.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:04.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:04.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:04.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:04.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:05.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:05.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:05.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:05.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:06.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:06.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:06.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:06.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:07.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:07.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:07.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:07.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:08.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:08.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:08.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:08.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:09.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:09.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:09.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:09.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:10.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:10.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:10.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:10.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:11.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:11.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:11.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:11.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:12.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:12.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:12.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:12.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:13.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:13.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:13.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:13.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:14.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:14.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:15.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:15.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:15.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:15.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:16.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:16.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:16.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:16.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:17.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:17.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:17.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:17.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:17.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:17.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:18.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:18.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:18.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:18.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:19.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:19.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:19.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:19.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:20.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:20.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:20.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:20.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:21.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:21.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:21.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:21.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:22.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:22.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:22.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:22.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:23.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:23.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:23.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:23.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:24.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:24.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:24.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:24.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:25.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:25.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:25.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:25.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:26.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:26.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:26.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:26.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:27.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:27.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 15 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:27.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:27.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:28.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:28.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:28.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:28.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:29.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:29.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:29.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:29.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:30.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:30.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:30.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:30.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:31.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:31.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:31.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:31.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:32.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:32.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:32.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:32.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:33.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:33.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:33.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:33.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:34.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:34.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:34.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:34.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:35.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:35.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:35.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:35.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:36.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:36.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:36.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:36.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:37.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:37.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:37.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:37.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:38.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:38.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:38.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:38.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:39.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:39.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:39.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:39.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:40.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:40.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:40.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:40.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:41.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:41.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:41.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:41.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:42.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:42.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:42.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:42.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:43.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:43.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:43.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:43.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:44.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:44.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:44.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:44.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:45.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:45.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:45.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:45.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:46.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:46.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:46.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:46.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:47.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:47.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:47.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:47.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:48.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:48.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:48.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:48.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:49.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:49.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:49.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:49.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:50.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:50.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:50.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:50.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:51.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:51.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:51.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:51.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:52.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:52.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:52.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:52.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:53.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:53.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:53.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:53.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:54.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:54.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:54.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:54.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:55.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:55.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:55.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:55.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:56.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:56.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:56.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:56.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:57.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:57.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T16:40:57.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:57.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:58.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:58.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:58.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:58.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:59.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:40:59.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:40:59.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:40:59.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:00.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:00.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:00.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:00.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:01.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:01.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:01.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:01.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:02.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:02.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:02.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:02.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:03.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:03.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:03.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:03.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:04.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:04.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:04.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:04.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:05.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:05.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:05.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:05.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:06.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:06.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:06.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:06.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:07.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:07.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:07.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:07.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:08.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:08.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:08.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:08.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:09.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:09.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:09.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:09.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:10.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:10.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:10.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:10.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:11.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:11.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:11.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:11.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:12.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:12.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:12.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:12.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:13.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:13.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:13.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:13.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:14.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:14.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:14.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:14.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:15.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:15.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:15.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:15.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:16.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:16.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:16.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:16.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:17.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:17.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:17.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:17.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:18.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:18.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:18.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:18.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:19.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:19.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:19.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:19.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:20.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:20.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:20.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:20.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:21.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:21.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:21.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:21.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:22.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:22.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:22.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:22.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:23.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:23.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:23.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:23.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:24.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:24.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:24.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:24.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:25.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:25.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:25.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:25.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:26.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:26.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:26.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:26.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:27.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:27.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:27.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:27.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:28.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:28.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:28.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:28.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:29.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:29.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:29.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:29.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:30.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:30.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:30.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:30.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:31.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:31.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:31.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:31.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:32.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:32.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:32.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:32.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:33.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:33.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:33.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:33.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:34.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:34.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:34.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:34.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:35.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:35.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:35.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:35.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:36.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:36.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:36.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:36.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:37.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:37.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:37.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:37.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:38.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:38.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:38.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:38.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:39.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:39.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:39.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:39.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:40.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:40.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:40.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:40.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:41.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:41.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:41.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:41.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:42.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:42.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:42.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:42.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:43.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:43.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:43.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:43.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:44.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:44.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:44.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:44.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:45.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:45.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:45.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:45.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:46.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:46.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:46.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:46.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:47.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:47.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:47.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:47.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:48.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:48.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:48.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:48.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:49.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:49.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:49.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:49.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:50.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:50.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:50.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:50.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:51.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:51.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:51.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:51.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:52.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:52.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:52.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:52.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:53.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:53.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:53.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:53.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:54.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:54.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:54.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:54.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:55.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:55.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:55.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:55.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:56.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:56.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:56.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:56.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:57.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:57.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:57.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:57.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:57.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:58.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:58.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:58.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:59.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:41:59.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:41:59.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:41:59.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:00.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:00.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:00.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:00.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:01.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:01.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:01.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:01.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:02.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:02.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:02.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:02.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:03.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:03.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:03.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:03.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:03.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:03.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:04.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:04.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:05.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:05.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:05.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:05.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:06.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:06.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:06.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:06.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:07.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:07.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:07.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:07.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:07.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:08.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:08.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:08.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:08.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:08.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:09.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:09.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:10.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:10.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:10.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:10.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:11.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:11.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:11.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:11.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:12.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:12.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:12.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:12.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:13.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:13.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:13.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:13.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:13.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:13.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:14.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:14.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:14.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:15.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:15.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:15.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:15.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:15.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:16.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:16.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:16.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:16.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:17.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:17.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:17.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:17.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:18.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:18.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:18.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:18.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:19.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:19.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:19.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:19.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:20.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:20.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:20.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:20.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:21.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:21.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:21.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:21.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:22.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:22.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:22.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:22.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:23.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:23.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:23.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:23.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:24.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:24.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:24.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:24.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:25.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:25.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:25.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:25.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:26.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:26.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:26.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:26.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:27.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:27.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:27.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:27.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:28.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:28.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:28.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:28.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:29.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:29.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:29.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:29.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:30.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:30.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:30.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:30.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:31.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:31.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:31.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:31.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:32.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:32.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:32.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:32.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:33.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:33.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:33.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:33.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:34.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:34.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:34.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:34.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:35.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:35.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:35.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:35.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:36.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:36.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:36.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:36.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:37.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:37.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:37.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:37.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:38.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:38.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:38.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:38.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:39.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:39.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:39.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:39.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:40.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:40.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:40.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:40.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:41.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:41.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:41.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:41.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:42.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:42.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:42.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:42.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:43.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:43.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:43.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:43.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:44.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:44.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:44.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:44.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:45.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:45.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:45.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:45.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:46.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:46.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:46.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:46.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:47.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:47.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:47.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:47.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:48.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:48.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:48.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:48.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:49.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:49.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:49.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:49.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:50.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:50.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:50.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:50.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:51.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:51.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:51.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:51.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:52.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:52.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:52.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:52.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:53.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:53.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:53.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:53.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:54.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:54.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:54.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:54.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:55.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:55.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:55.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:55.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:56.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:56.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:56.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:56.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:57.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:57.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:57.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:57.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:58.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:58.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:59.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:59.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:59.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:42:59.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:42:59.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:42:59.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:00.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:00.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:00.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:00.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:01.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:01.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:01.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:02.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:02.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:02.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:03.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:03.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:03.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:03.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:04.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:04.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:04.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:04.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:05.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:05.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:05.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:05.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:06.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:06.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:06.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:06.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:07.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:07.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:07.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:07.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:08.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:08.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:08.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:08.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:09.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:09.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:09.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:09.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:09.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:10.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:10.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:10.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:11.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:11.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:11.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:11.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:11.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:11.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:12.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:12.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:13.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:13.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:13.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:13.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:14.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:14.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:14.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:14.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:15.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:15.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:15.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:15.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:16.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:16.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:16.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:16.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:17.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:17.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:17.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:17.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:18.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:18.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:18.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:18.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:19.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:19.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:19.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:19.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:20.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:20.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:20.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:20.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:21.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:21.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:21.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:21.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:22.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:22.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:22.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:22.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:23.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:23.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:23.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:23.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:24.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:24.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:24.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:24.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:25.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:25.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:25.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:25.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:26.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:26.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:26.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:26.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:27.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:27.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:27.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:27.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:28.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:28.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:28.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:28.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:29.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:29.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:29.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:29.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:30.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:30.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:30.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:30.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:31.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:31.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:31.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:31.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:32.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:32.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:32.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:32.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:33.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:33.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:33.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:33.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:34.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:34.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:34.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:34.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:35.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:35.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:35.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:35.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:36.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:36.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:36.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:36.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:37.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:37.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:37.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:37.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:38.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:38.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:38.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:38.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:39.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:39.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:39.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:39.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:40.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:40.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:40.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:40.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:41.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:41.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:41.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:41.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:42.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:42.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:42.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:42.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:43.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:43.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:43.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:43.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:44.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:44.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:44.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:44.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:45.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:45.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:45.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:45.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:46.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:46.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:46.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:46.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:47.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:47.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:47.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:47.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:48.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:48.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:48.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:48.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:49.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:49.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:49.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:49.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:50.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:50.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:50.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:50.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:51.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:51.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:51.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:51.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:52.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:52.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:52.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:52.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:53.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:53.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:53.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:53.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:54.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:54.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:54.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:54.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:55.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:55.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:55.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:55.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:56.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:56.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:56.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:56.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:57.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:57.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:57.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:57.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:58.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:58.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:58.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:58.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:59.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:43:59.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:43:59.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:43:59.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:00.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:00.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:00.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:00.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:01.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:01.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:01.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:01.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:02.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:02.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:02.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:02.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:03.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:03.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:03.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:03.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:04.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:04.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:04.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:04.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:05.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:05.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:05.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:05.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:06.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:06.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:06.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:06.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:07.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:07.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:07.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:07.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:08.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:08.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:08.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:08.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:09.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:09.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:09.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:09.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:10.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:10.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:10.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:10.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:11.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:11.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:11.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:11.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:12.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:12.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:12.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:12.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:13.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:13.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:13.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:13.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:14.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:14.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:14.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:14.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:15.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:15.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:15.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:15.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:16.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:16.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:16.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:16.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:17.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:17.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:17.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:17.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:18.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:18.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:18.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:18.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:19.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:19.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:19.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:19.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:20.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:20.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:20.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:20.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:21.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:21.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:21.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:21.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:22.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:22.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:22.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:22.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:23.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:23.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:23.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:23.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:24.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:24.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:24.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:24.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:25.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:25.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:25.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:25.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:26.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:26.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:26.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:26.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:27.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:27.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:27.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:27.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:28.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:28.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:28.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:28.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:29.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:29.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:29.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:29.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:30.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:30.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:30.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:30.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:31.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:31.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:31.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:31.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:32.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:32.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:32.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:32.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:33.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:33.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:33.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:33.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:34.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:34.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:34.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:34.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:35.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:35.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:35.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:35.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:36.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:36.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:36.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:36.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:37.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:37.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:37.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:37.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:38.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:38.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:38.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:38.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:39.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:39.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:39.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:39.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:40.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:40.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:40.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:40.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:41.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:41.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:41.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:41.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:42.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:42.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:42.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:42.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:43.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:43.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:43.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:43.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:44.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:44.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:44.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:44.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:45.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:45.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:45.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:45.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:46.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:46.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:46.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:46.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:47.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:47.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:47.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:47.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:48.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:48.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:48.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:48.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:49.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:49.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:49.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:49.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:50.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:50.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:50.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:50.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:51.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:51.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:51.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:51.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:52.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:52.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:52.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:52.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:53.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:53.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:53.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:53.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:54.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:54.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:54.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:54.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:55.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:55.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:55.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:55.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:56.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:56.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:56.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:56.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:57.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:57.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:57.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:57.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:58.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:58.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:58.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:58.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:59.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:44:59.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:44:59.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:44:59.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:00.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:00.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:00.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:00.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:01.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:01.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:01.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:01.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:02.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:02.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:02.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:02.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:03.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:03.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:03.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:03.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:04.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:04.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:04.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:04.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:05.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:05.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:05.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:05.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:06.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:06.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:06.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:06.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:07.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:07.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:07.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:07.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:08.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:08.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:08.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:08.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:09.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:09.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:09.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:09.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:10.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:10.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:10.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:10.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:11.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:11.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:11.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:11.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:12.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:12.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:12.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:12.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:13.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:13.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:13.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:13.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:14.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:14.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:14.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:14.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:15.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:15.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:15.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:15.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:16.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:16.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:16.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:16.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:17.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:17.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:17.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:17.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:18.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:18.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:18.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:18.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:19.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:19.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:19.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:19.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:20.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:20.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:20.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:20.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:21.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:21.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:21.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:21.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:22.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:22.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:22.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:22.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:23.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:23.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:23.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:23.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:24.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:24.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:24.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:24.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:25.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:25.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:25.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:25.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:26.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:26.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:26.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:26.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:27.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:27.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:27.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:27.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:28.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:28.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:28.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:28.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:29.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:29.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:29.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:29.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:30.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:30.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:30.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:30.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:31.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:31.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:31.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:31.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:32.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:32.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:32.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:32.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:33.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:33.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:33.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:33.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:34.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:34.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:34.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:34.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:35.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:35.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:35.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:35.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:36.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:36.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:36.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:36.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:37.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:37.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:37.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:37.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:38.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:38.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:38.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:38.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:39.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:39.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:39.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:39.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:40.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:40.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:40.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:40.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:41.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:41.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:41.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:41.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:42.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:42.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:42.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:42.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:43.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:43.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:43.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:43.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:44.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:44.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:44.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:44.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:45.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:45.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:45.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:45.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:46.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:46.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:46.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:46.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:47.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:47.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:47.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:47.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:48.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:48.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:48.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:48.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:49.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:49.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:49.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:49.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:50.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:50.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:50.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:50.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:51.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:51.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:51.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:51.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:52.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:52.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:52.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:52.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:53.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:53.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:53.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:53.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:54.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:54.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:54.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:54.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:55.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:55.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:55.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:55.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:56.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:56.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:56.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:56.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:57.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:57.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:57.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:57.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:58.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:58.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:58.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:58.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:59.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:45:59.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:45:59.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:45:59.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:00.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:00.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:00.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:00.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:01.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:01.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:01.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:01.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:02.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:02.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:02.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:02.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:03.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:03.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:03.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:03.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:04.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:04.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:04.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:04.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:05.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:05.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:05.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:05.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:06.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:06.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:06.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:06.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:07.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:07.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:07.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:07.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:08.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:08.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:08.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:08.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:09.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:09.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:09.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:09.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:10.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:10.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:10.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:10.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:11.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:11.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:11.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:11.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:12.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:12.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:12.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:12.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:13.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:13.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:13.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:13.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:14.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:14.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:14.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:14.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:15.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:15.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:15.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:15.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:16.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:16.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:16.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:16.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:17.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:17.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:17.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:17.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:18.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:18.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:18.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:18.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:19.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:19.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:19.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:19.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:20.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:20.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:20.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:20.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:21.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:21.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:21.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:21.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:22.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:22.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:22.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:22.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:23.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:23.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:23.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:23.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:24.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:24.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:24.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:24.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:25.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:25.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:25.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:25.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:26.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:26.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:26.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:26.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:27.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:27.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:27.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:27.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:28.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:28.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:28.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:28.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:29.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:29.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:29.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:29.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:30.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:30.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:30.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:30.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:31.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:31.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:31.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:31.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:32.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:32.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:32.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:32.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:33.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:33.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:33.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:33.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:34.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:34.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:34.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:34.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:35.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:35.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:35.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:35.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:36.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:36.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:36.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:36.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:37.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:37.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:37.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:37.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:38.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:38.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:38.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:38.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:39.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:39.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:39.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:39.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:40.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:40.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:40.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:40.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:41.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:41.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:41.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:41.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:42.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:42.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:42.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:42.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:43.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:43.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:43.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:43.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:44.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:44.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:44.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:44.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:45.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:45.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:45.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:45.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:46.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:46.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:46.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:46.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:47.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:47.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:47.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:47.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:48.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:48.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:48.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:48.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:49.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:49.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:49.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:49.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:50.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:50.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:50.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:50.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:51.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:51.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:51.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:51.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:52.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:52.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:52.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:52.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:53.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:53.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:53.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:53.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:54.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:54.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:54.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:54.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:55.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:55.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:55.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:55.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:56.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:56.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:56.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:56.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:57.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:57.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:58.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:58.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:58.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:58.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:58.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:58.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:59.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:46:59.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:46:59.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:46:59.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:00.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:00.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:00.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:00.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:01.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:01.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:01.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:01.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:02.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:02.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:02.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:02.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:03.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:03.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:03.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:03.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:04.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:04.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:04.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:04.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:05.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:05.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:05.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:05.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:06.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:06.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:07.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:07.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:07.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:07.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:07.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:08.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:08.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:08.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:09.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:09.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:09.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:09.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:10.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:10.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:10.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:10.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:11.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:11.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:11.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:11.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:11.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:11.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:12.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:12.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:13.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:13.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:13.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:14.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:14.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:14.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:15.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:15.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:15.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:15.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:15.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:16.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:16.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:16.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:16.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:16.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:17.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:17.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:17.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:17.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:18.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:18.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:19.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:19.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:19.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:19.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:20.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:20.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:20.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:20.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:21.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:21.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:21.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:21.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:21.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:21.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:22.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:22.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:22.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:22.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:23.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:23.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:23.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:23.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:24.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:24.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:24.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:24.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:25.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:25.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:25.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:25.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:26.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:26.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:26.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:26.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:27.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:27.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:27.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:27.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:28.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:28.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:28.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:28.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:29.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:29.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:29.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:29.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:30.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:30.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:30.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:30.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:31.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:31.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:31.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:31.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:31.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:31.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:32.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:32.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:33.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:33.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:33.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:33.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:34.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:34.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:34.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:34.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:35.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:35.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:35.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:35.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:36.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:36.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:36.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:36.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:37.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:37.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:37.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:37.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:38.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:38.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:38.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:38.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:39.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:39.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:39.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:39.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:40.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:40.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:40.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:40.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:41.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:41.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:41.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:41.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:42.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:42.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:42.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:42.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:43.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:43.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:43.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:43.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:44.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:44.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:44.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:44.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:45.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:45.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:45.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:45.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:46.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:46.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:46.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:46.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:46.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:46.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:47.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:47.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:47.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:47.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:48.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:48.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:48.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:49.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:49.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:49.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:49.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:49.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:50.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:50.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:51.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:51.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:51.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:51.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:52.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:52.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:52.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:52.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:53.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:53.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:53.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:53.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:54.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:54.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:54.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:54.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:55.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:55.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:55.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:55.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:56.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:56.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:56.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:56.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:57.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:57.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:57.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:57.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:58.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:58.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:58.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:58.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:59.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:47:59.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:47:59.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:47:59.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:00.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:00.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:00.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:00.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:01.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:01.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:01.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:01.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:01.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:01.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:02.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:02.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:03.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:03.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:03.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:03.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:04.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:04.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:04.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:04.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:05.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:05.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:05.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:05.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:06.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:06.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:06.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:06.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:06.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:07.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:07.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:07.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:08.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:08.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 11 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:08.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:08.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:09.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:09.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:09.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:09.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:10.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:10.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:10.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:10.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:10.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:11.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:11.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:11.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:11.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:11.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:12.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:12.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:12.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:12.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:13.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:13.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:13.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:13.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:14.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:14.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:14.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:14.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:15.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:15.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:15.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:15.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:16.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:16.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:16.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:16.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:17.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:17.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:17.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:17.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:18.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:18.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:18.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:18.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:19.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:19.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:19.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:19.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:20.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:20.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:20.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:20.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:21.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:21.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:22.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:22.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:22.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:23.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:23.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:23.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:23.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:23.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:24.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:24.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:24.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:24.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:24.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:25.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:25.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:25.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:25.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:25.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:26.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:26.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:26.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:27.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:27.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:27.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:28.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:28.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:28.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:28.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:29.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:29.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:29.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:29.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:30.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:30.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:30.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:30.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:31.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:31.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:31.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:31.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:32.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:32.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:32.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:32.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:33.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:33.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:33.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:33.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:34.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:34.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:34.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:34.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:35.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:35.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:35.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:35.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:36.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:36.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:36.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:36.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:37.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:37.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:37.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:38.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:38.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:38.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:38.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:38.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:39.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:39.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:39.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:39.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:40.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:40.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:40.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:41.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:41.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:41.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:42.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:42.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:42.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:42.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:43.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:43.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:43.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:43.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:44.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:44.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:44.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:44.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:45.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:45.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:45.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:45.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:46.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:46.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:46.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:46.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:47.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:47.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:47.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:47.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:48.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:48.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:48.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:48.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:49.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:49.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:49.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:49.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:50.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:50.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:50.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:50.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:51.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:51.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:51.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:51.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:52.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:52.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:52.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:52.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:53.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:53.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:53.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:53.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:54.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:54.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:54.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:54.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:55.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:55.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:55.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:55.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:56.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:56.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:56.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:56.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:57.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:57.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:57.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:57.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:58.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:58.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:58.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:58.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:59.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:48:59.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:48:59.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:48:59.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:00.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:00.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:00.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:00.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:01.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:01.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:01.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:01.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:02.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:02.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:02.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:02.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:03.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:03.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:03.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:03.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:04.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:04.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:04.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:04.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:05.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:05.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:05.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:05.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:06.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:06.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:06.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:06.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:07.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:07.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:07.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:07.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:08.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:08.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:08.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:08.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:09.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:09.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:09.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:09.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:10.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:10.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:10.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:10.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:11.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:11.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:11.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:11.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:12.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:12.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:12.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:12.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:13.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:13.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:13.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:13.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:14.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:14.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:14.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:14.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:15.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:15.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:15.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:15.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:16.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:16.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:16.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:16.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:17.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:17.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:17.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:17.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:18.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:18.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:18.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:18.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:19.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:19.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:19.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:19.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:20.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:20.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:20.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:20.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:21.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:21.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:21.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:21.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:22.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:22.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:22.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:22.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:23.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:23.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:23.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:23.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:24.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:24.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:24.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:24.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:25.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:25.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:25.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:25.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:26.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:26.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:26.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:26.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:27.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:27.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:27.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:27.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:28.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:28.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:28.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:28.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:29.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:29.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:29.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:29.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:30.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:30.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:30.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:30.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:31.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:31.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:31.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:31.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:32.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:32.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:32.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:32.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:33.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:33.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:33.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:33.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:34.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:34.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:34.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:34.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:35.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:35.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:35.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:35.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:36.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:36.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:36.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:36.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:37.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:37.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:37.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:37.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:38.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:38.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:38.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:38.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:39.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:39.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:39.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:39.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:40.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:40.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:40.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:40.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:41.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:41.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:41.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:41.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:42.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:42.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:42.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:42.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:43.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:43.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:43.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:43.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:44.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:44.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:44.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:44.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:45.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:45.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:45.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:45.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:46.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:46.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:46.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:46.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:47.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:47.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:47.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:47.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:48.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:48.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:48.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:48.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:49.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:49.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:49.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:49.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:50.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:50.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:50.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:50.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:51.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:51.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:51.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:51.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:52.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:52.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:52.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:52.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:53.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:53.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:53.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:53.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:54.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:54.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:54.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:54.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:55.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:55.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:55.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:55.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:56.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:56.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:56.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:56.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:57.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:57.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:57.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:57.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:58.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:58.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:58.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:58.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:59.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:49:59.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:49:59.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:49:59.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:00.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:00.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:00.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:00.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:01.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:01.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:01.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:01.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:02.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:02.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:02.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:02.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:03.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:03.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:03.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:03.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:04.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:04.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:04.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:04.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:05.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:05.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:05.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:05.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:06.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:06.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:06.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:06.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:07.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:07.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:07.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:07.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:08.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:08.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:08.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:08.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:09.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:09.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:09.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:09.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:10.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:10.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:10.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:10.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:11.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:11.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:11.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:11.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:12.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:12.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:12.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:12.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:13.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:13.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:13.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:13.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:14.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:14.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:14.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:14.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:15.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:15.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:15.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:15.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:16.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:16.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:16.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:16.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:17.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:17.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:17.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:17.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:18.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:18.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:18.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:18.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:19.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:19.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:19.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:19.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:20.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:20.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:20.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:20.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:21.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:21.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:21.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:21.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:22.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:22.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:22.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:22.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:23.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:23.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:23.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:23.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:24.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:24.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:24.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:24.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:25.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:25.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:25.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:25.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:26.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:26.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:26.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:26.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:27.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:27.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:27.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:27.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:28.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:28.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:28.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:28.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:29.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:29.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:29.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:29.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:30.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:30.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:30.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:30.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:31.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:31.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:31.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:31.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:32.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:32.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:32.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:32.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:33.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:33.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:33.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:33.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:34.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:34.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:34.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:34.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:35.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:35.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:35.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:35.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:36.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:36.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:36.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:36.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:37.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:37.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:37.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:37.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:38.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:38.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:38.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:38.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:39.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:39.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:39.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:39.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:40.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:40.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:40.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:40.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:41.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:41.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:41.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:41.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:42.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:42.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:42.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:42.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:43.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:43.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:43.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:43.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:44.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:44.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:44.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:44.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:45.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:45.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:45.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:45.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:46.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:46.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:46.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:46.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:47.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:47.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:47.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:47.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:48.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:48.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:48.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:48.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:49.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:49.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:49.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:49.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:50.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:50.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:50.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:50.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:51.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:51.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:51.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:51.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:52.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:52.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:52.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:52.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:53.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:53.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:53.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:53.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:54.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:54.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:54.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:54.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:55.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:55.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:55.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:55.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:56.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:56.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:56.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:56.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:57.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:57.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:57.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:57.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:58.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:58.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:58.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:58.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:59.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:50:59.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:50:59.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:50:59.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:00.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:00.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:00.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:00.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:01.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:01.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:01.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:01.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:02.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:02.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:02.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:02.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:03.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:03.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:03.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:03.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:04.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:04.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:04.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:04.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:05.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:05.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:05.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:05.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:06.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:06.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:06.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:06.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:07.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:07.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:07.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:07.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:08.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:08.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:08.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:08.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:09.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:09.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:09.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:09.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:10.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:10.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:10.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:10.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:11.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:11.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:11.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:11.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:12.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:12.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:12.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:12.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:13.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:13.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:13.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:13.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:14.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:14.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:14.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:14.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:15.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:15.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:15.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:15.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:16.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:16.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:16.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:16.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:17.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:17.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:17.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:17.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:18.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:18.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:18.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:18.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:19.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:19.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:19.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:19.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:20.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:20.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:20.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:20.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:21.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:21.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:21.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:21.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:22.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:22.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:22.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:22.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:23.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:23.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:23.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:23.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:24.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:24.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:24.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:24.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:25.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:25.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:25.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:25.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:26.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:26.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:26.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:26.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:27.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:27.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:27.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:27.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:28.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:28.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:28.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:28.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:29.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:29.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:29.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:29.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:30.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:30.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:30.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:30.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:31.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:31.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:31.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:31.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:32.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:32.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:32.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:32.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:33.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:33.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:33.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:33.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:34.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:34.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:34.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:34.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:35.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:35.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:35.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:35.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:36.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:36.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:36.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:36.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:37.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:37.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:37.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:37.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:38.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:38.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:38.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:38.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:39.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:39.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:39.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:39.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:40.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:40.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:40.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:40.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:41.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:41.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:41.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:41.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:42.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:42.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:42.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:42.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:43.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:43.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:43.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:43.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:44.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:44.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:44.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:44.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:45.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:45.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:45.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:45.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:46.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:46.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:46.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:46.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:47.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:47.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:47.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:47.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:48.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:48.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:48.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:48.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:49.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:49.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:49.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:49.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:50.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:50.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:50.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:50.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:51.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:51.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:51.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:51.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:52.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:52.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:52.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:52.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:53.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:53.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:53.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:53.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:54.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:54.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:54.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:54.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:55.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:55.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:55.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:55.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:56.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:56.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:56.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:56.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:57.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:57.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:57.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:57.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:58.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:58.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:58.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:58.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:59.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:51:59.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:51:59.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:51:59.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:00.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:00.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:00.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:00.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:01.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:01.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:01.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:01.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:02.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:02.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:02.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:02.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:03.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:03.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:03.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:03.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:04.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:04.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:04.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:04.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:05.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:05.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:05.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:05.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:06.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:06.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:06.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:06.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:07.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:07.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:07.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:07.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:08.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:08.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:08.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:08.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:09.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:09.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:09.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:09.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:10.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:10.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:10.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:10.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:11.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:11.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:11.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:11.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:12.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:12.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:12.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:12.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:13.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:13.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:13.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:13.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:14.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:14.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:14.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:14.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:15.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:15.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:15.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:15.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:16.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:16.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:16.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:16.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:17.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:17.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:17.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:17.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:18.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:18.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:18.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:18.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:19.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:19.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:19.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:19.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:20.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:20.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:20.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:20.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:21.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:21.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:21.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:21.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:22.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:22.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:22.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:22.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:22.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:22.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:23.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:23.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:23.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:23.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:24.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:24.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:24.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:24.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:25.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:25.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:25.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:25.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:26.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:26.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:26.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:26.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:27.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:27.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:27.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:27.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:28.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:28.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:28.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:28.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:29.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:29.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:29.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:29.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:30.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:30.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:31.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:31.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:31.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:31.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:32.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:32.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:32.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:32.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:33.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:33.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:33.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:33.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:34.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:34.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:34.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:34.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:35.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:35.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:35.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:35.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:36.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:36.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:36.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:36.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:37.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:37.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:37.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:37.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:37.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:38.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:38.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:38.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:39.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:39.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:39.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:39.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:39.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:39.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:40.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:40.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:40.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:40.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:41.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:41.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:41.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:41.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:42.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:42.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:42.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:42.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:43.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:43.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:43.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:43.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:44.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:44.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:44.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:44.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:45.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:45.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:45.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:45.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:46.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:46.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:46.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:46.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:47.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:47.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:47.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:47.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:48.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:48.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:48.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:49.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:49.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:49.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:50.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:50.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:50.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:50.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:51.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:51.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:51.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:51.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:52.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:52.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:52.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:52.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:53.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:53.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:53.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:53.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:53.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:54.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:54.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:54.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:54.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:54.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:55.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:55.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:55.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:56.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:56.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:56.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:56.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:56.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:57.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:57.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:57.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:57.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:58.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:58.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:58.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:58.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:59.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:52:59.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:52:59.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:52:59.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:00.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:00.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:00.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:00.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:01.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:01.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:01.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:01.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:02.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:02.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:02.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:02.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:03.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:03.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:03.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:03.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:04.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:04.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:04.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:04.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:05.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:05.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:05.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:05.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:06.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:06.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:06.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:06.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:07.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:07.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:07.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:07.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:08.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:08.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:08.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:08.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:09.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:09.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:09.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:09.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:10.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:10.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:10.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:10.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:11.413 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T16:53:11.425+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x55ddecea29e0 msgr2=0x7f81ac04a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T16:53:11.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:11.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:11.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:11.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:12.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:12.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:12.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:12.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:13.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:13.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:13.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:13.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:14.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:14.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:14.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:14.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:15.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:15.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:15.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:15.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:16.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:16.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:16.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:16.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:17.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:17.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:17.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:17.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:18.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:18.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:18.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:18.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:19.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:19.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:19.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:19.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:20.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:20.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:20.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:20.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:21.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:21.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:21.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:21.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:22.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:22.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:22.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:23.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:23.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:23.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:23.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:23.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:24.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:24.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:24.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:25.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:25.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:25.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:25.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:26.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:26.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:26.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:26.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:26.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:27.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:27.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:28.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:28.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:28.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:28.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:29.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:29.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:29.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:29.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:30.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:30.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:30.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:30.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:31.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:31.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:31.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:31.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:32.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:32.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:32.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:32.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:33.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:33.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:33.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:33.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:34.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:34.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:34.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:34.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:35.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:35.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:35.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:35.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:36.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:36.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:36.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:36.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:37.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:37.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:37.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:37.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:38.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:38.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:38.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:38.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:39.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:39.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:39.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:39.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:40.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:40.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:40.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:40.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:41.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:41.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:41.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:41.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:42.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:42.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:42.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:42.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:43.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:43.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:43.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:43.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:44.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:44.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:44.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:44.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:45.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:45.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:45.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:45.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:46.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:46.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:46.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:46.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:47.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:47.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:47.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:47.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:48.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:48.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:48.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:48.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:49.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:49.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:49.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:49.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:50.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:50.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:50.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:50.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:51.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:51.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:51.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:51.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:52.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:52.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:52.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:52.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:53.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:53.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:53.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:53.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:54.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:54.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:54.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:54.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:55.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:55.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:55.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:55.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:56.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:56.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:56.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:56.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:57.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:57.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:57.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:57.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:58.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:58.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:58.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:58.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:59.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:53:59.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:53:59.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:53:59.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:00.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:00.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:00.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:00.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:01.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:01.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:01.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:01.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:02.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:02.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:02.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:02.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:03.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:03.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:03.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:03.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:04.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:04.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:04.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:04.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:05.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:05.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:05.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:05.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:06.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:06.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:06.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:06.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:07.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:07.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:07.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:07.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:08.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:08.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:08.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:08.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:09.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:09.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:09.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:09.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:10.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:10.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:10.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:10.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:11.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:11.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:11.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:11.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:12.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:12.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:12.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:12.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:13.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:13.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:13.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:13.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:14.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:14.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:14.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:14.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:15.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:15.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:15.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:15.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:16.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:16.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:16.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:16.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:17.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:17.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:17.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:17.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:18.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:18.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:18.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:18.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:19.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:19.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:19.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:19.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:20.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:20.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:20.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:20.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:21.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:21.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:21.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:21.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:22.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:22.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:22.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:22.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:23.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:23.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:23.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:23.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:24.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:24.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:24.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:24.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:25.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:25.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:25.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:25.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:26.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:26.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:26.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:26.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:27.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:27.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:28.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:28.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:28.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:28.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:29.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:29.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:29.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:29.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:29.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:29.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:30.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:30.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:31.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:31.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:31.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:31.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:31.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:32.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:32.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:32.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:33.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:33.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:33.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:33.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:34.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:34.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:34.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:34.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:35.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:35.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:35.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:35.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:36.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:36.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:36.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:36.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:37.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:37.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:37.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:37.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:38.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:38.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:38.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:38.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:39.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:39.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:39.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:39.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:40.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:40.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:40.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:40.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:41.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:41.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:41.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:41.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:42.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:42.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:42.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:42.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:43.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:43.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:43.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:43.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:44.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:44.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:44.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:44.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:45.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:45.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:45.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:45.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:46.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:46.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:46.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:46.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:47.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:47.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:47.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:47.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:48.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:48.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:48.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:48.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:49.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:49.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:49.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:49.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:50.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:50.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:50.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:50.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:51.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:51.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:51.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:51.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:52.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:52.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:52.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:52.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:53.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:53.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:53.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:53.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:54.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:54.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:54.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:54.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:55.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:55.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:55.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:55.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:56.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:56.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:56.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:56.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:57.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:57.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:57.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:57.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:58.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:58.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:58.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:58.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:59.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:54:59.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:54:59.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:54:59.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:00.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:00.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:00.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:00.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:01.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:01.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:01.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:01.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:01.432 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T16:55:01.445+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81a8004bb0 msgr2=0x7f81ac057530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T16:55:02.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:02.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:02.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:02.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:03.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:03.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:03.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:03.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:04.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:04.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:04.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:04.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:05.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:05.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:05.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:05.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:06.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:06.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:06.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:06.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:07.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:07.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:07.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:07.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:08.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:08.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:08.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:08.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:09.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:09.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:09.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:09.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:10.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:10.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:10.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:10.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:11.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:11.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:11.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:11.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:11.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:12.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:12.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:12.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:12.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:12.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:13.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:13.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:13.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:13.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:14.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:14.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:14.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:14.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:15.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:15.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:15.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:15.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:16.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:16.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:16.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:16.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:17.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:17.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:17.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:17.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:18.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:18.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:18.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:18.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:19.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:19.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:19.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:19.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:20.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:20.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:20.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:20.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:21.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:21.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:21.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:21.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:22.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:22.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:23.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:23.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:23.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:23.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:23.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:23.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:24.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:24.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:24.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:24.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:25.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:25.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:25.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:25.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:26.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:26.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:27.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:27.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:27.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:27.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:28.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:28.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:28.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:28.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:29.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:29.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:29.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:29.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:30.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:30.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:30.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:30.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:31.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:31.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:31.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:31.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:32.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:32.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:32.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:32.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:33.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:33.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:33.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:33.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:34.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:34.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:34.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:34.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:35.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:35.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:35.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:35.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:36.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:36.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:36.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:36.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:37.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:37.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:37.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:37.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:38.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:38.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:38.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:38.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:39.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:39.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:39.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:39.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:40.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:40.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:40.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:40.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:41.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:41.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:41.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:41.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:42.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:42.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:42.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:42.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:43.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:43.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:43.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:43.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:44.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:44.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:44.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:44.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:45.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:45.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:45.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:45.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:46.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:46.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:46.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:46.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:47.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:47.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:47.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:47.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:48.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:48.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:48.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:48.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:49.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:49.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:49.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:49.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:50.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:50.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:50.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:50.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:51.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:51.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:51.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:51.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:52.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:52.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:52.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:52.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:53.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:53.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:53.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:53.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:54.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:54.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:54.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:54.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:55.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:55.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:55.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:55.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:56.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:56.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:56.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:56.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:57.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:57.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:57.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:57.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:58.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:58.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:58.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:58.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:59.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:55:59.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:55:59.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:55:59.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:00.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:00.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:00.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:00.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:01.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:01.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:01.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:01.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:02.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:02.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:02.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:02.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:03.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:03.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:03.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:03.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:04.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:04.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:04.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:04.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:05.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:05.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:05.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:05.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:06.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:06.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:06.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:06.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:07.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:07.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:07.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:07.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:08.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:08.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:08.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:08.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:09.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:09.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:09.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:09.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:10.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:10.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:10.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:10.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:11.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:11.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:11.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:11.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:12.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:12.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:12.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:12.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:13.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:13.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:13.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:13.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:14.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:14.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:14.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:14.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:15.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:15.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:15.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:15.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:16.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:16.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:16.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:16.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:17.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:17.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:17.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:17.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:18.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:18.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:18.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:18.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:19.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:19.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:19.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:19.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:20.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:20.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:20.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:20.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:21.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:21.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:21.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:21.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:22.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:22.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:22.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:22.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:23.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:23.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:23.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:23.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:24.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:24.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:24.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:24.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:25.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:25.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:25.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:25.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:26.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:26.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:26.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:26.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:27.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:27.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:27.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:27.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:28.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:28.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:28.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:28.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:29.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:29.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:29.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:29.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:30.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:30.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:30.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:30.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:31.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:31.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:31.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:31.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:32.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:32.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:32.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:32.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:33.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:33.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:33.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:33.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:34.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:34.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:34.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:34.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:35.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:35.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:35.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:35.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:36.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:36.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:36.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:36.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:37.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:37.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:37.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:37.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:38.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:38.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:38.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:38.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:39.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:39.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:39.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:39.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:40.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:40.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:40.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:40.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:41.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:41.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:41.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:41.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:42.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:42.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:42.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:42.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:43.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:43.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:43.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:43.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:44.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:44.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:44.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:44.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:45.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:45.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:45.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:45.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:46.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:46.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:46.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:46.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:47.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:47.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:47.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:47.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:48.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:48.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:48.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:48.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:49.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:49.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:49.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:49.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:50.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:50.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:50.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:50.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:51.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:51.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:51.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:51.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:52.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:52.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:52.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:52.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:53.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:53.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:53.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:53.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:54.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:54.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:54.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:54.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:55.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:55.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:55.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:55.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:56.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:56.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:56.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:56.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:57.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:57.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:57.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:57.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:58.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:58.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:58.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:58.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:59.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:56:59.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:56:59.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:56:59.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:00.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:00.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:00.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:00.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:01.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:01.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:01.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:01.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:02.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:02.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:02.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:02.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:03.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:03.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:03.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:03.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:04.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:04.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:04.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:04.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:05.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:05.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:05.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:05.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:06.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:06.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:06.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:06.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:07.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:07.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:07.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:07.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:08.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:08.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:08.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:08.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:09.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:09.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:09.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:09.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:10.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:10.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:10.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:10.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:11.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:11.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:11.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:11.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:12.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:12.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:12.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:12.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:13.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:13.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:13.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:13.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:14.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:14.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:14.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:14.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:15.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:15.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:15.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:15.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:16.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:16.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:16.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:16.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:17.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:17.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:17.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:17.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:18.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:18.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:18.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:18.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:19.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:19.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:19.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:19.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:20.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:20.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:20.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:20.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:21.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:21.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:21.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:21.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:22.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:22.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:22.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:22.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:23.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:23.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:23.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:23.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:24.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:24.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:24.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:24.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:25.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:25.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:25.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:25.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:26.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:26.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:26.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:26.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:27.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:27.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:27.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:27.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:28.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:28.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:28.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:28.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:29.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:29.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:29.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:29.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:30.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:30.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:30.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:30.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:31.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:31.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:31.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:31.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:32.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:32.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:32.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:32.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:33.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:33.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:33.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:33.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:34.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:34.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:34.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:34.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:35.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:35.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:35.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:35.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:36.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:36.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:36.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:36.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:37.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:37.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:37.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:37.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:38.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:38.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:38.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:38.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:39.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:39.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:39.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:39.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:40.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:40.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:40.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:40.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:41.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:41.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:41.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:41.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:42.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:42.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:42.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:42.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:43.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:43.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:43.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:43.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:44.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:44.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:44.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:44.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:45.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:45.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:45.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:45.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:46.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:46.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:46.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:46.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:47.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:47.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:47.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:47.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:48.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:48.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:48.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:48.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:49.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:49.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:49.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:49.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:50.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:50.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:50.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:50.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:51.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:51.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:51.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:51.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:52.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:52.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:52.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:52.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:53.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:53.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:53.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:53.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:54.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:54.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:54.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:54.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:55.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:55.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:55.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:55.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:56.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:56.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:56.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:56.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:57.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:57.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:57.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:57.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:58.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:58.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:58.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:58.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:59.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:57:59.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:57:59.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:57:59.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:00.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:00.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:00.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:00.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:01.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:01.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:01.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:01.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:02.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:02.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:02.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:02.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:03.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:03.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:03.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:03.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:04.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:04.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:04.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:04.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:05.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:05.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:05.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:05.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:06.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:06.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:06.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:06.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:07.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:07.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:07.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:07.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:08.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:08.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:08.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:08.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:09.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:09.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:09.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:09.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:10.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:10.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:10.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:10.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:11.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:11.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:11.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:11.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:12.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:12.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:12.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:12.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:13.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:13.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:13.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:13.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:14.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:14.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:14.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:14.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:15.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:15.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:15.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:15.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:16.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:16.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:16.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:16.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:17.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:17.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:17.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:17.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:18.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:18.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:18.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:18.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:19.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:19.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:19.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:19.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:20.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:20.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:20.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:20.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:21.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:21.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:21.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:21.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:22.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:22.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:22.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:22.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:23.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:23.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:23.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:23.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:24.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:24.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:24.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:24.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:25.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:25.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:25.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:25.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:26.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:26.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:26.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:26.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:27.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:27.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:27.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:27.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:28.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:28.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:28.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:28.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:29.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:29.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:29.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:29.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:30.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:30.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:30.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:30.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:31.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:31.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:31.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:31.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:32.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:32.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:32.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:32.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:33.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:33.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:33.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:33.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:34.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:34.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:34.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:34.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:35.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:35.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:35.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:35.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:36.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:36.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:36.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:36.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:37.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:37.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:37.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:37.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:38.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:38.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:38.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:38.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:39.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:39.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:39.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:39.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:40.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:40.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:40.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:40.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:41.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:41.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:41.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:41.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:42.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:42.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:42.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:42.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:43.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:43.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:43.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:43.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:44.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:44.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:44.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:44.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:45.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:45.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:45.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:45.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:46.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:46.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:46.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:46.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:47.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:47.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:47.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:47.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:48.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:48.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:48.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:48.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:49.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:49.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:49.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:49.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:50.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:50.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:50.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:50.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:51.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:51.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:51.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:51.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:52.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:52.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:52.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:52.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:53.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:53.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:53.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:53.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:54.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:54.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:54.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:54.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:55.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:55.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:55.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:55.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:56.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:56.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:56.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:56.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:57.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:57.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:57.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:57.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:58.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:58.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:58.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:58.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:59.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:58:59.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:58:59.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:58:59.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:00.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:00.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:00.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:00.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:01.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:01.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:01.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:01.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:02.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:02.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:02.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:02.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:03.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:03.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:03.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:03.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:04.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:04.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:04.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:04.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:05.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:05.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:05.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:05.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:06.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:06.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:06.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:06.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:07.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:07.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:07.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:07.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:08.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:08.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:08.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:08.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:09.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:09.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:09.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:09.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:10.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:10.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:10.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:10.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:11.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:11.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:11.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:11.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:12.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:12.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:12.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:12.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:13.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:13.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:13.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:13.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:14.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:14.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:14.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:14.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:15.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:15.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:15.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:15.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:16.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:16.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:16.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:16.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:17.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:17.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:17.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:17.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:18.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:18.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:18.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:18.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:19.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:19.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:19.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:19.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:20.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:20.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:20.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:20.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:21.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:21.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:21.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:21.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:22.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:22.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:22.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:22.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:23.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:23.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:23.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:23.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:24.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:24.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:24.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:24.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:25.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:25.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:25.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:25.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:26.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:26.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:26.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:26.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:27.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:27.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:27.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:27.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:28.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:28.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:28.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:28.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:29.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:29.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:29.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:29.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:30.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:30.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:30.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:30.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:31.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:31.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:31.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:31.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:32.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:32.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:32.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:32.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:33.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:33.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:33.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:33.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:34.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:34.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:34.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:34.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:35.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:35.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:35.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:35.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:36.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:36.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:36.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:36.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:37.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:37.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:37.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:37.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:38.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:38.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:38.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:38.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:39.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:39.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:39.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:39.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:40.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:40.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:40.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:40.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:41.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:41.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:41.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:41.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:42.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:42.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:42.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:42.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:43.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:43.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:43.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:43.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:44.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:44.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:44.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:44.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:45.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:45.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:45.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:45.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:46.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:46.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:46.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:46.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:47.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:47.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:47.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:47.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:48.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:48.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:48.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:48.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:49.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:49.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:49.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:49.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:50.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:50.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:50.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:50.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:51.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:51.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:51.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:51.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:52.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:52.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:52.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:52.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:53.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:53.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:53.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:53.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:54.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:54.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:54.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:54.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:55.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:55.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:55.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:55.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:56.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:56.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:56.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:56.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:57.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:57.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:57.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:57.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:58.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:58.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:58.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:58.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:59.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T16:59:59.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T16:59:59.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T16:59:59.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:00.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:00.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:00.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:00.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:01.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:01.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:01.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:01.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:02.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:02.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:02.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:02.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:03.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:03.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:03.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:03.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:04.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:04.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:04.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:04.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:05.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:05.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:05.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:05.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:06.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:06.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:06.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:06.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:07.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:07.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:07.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:07.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:08.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:08.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:08.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:08.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:09.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:09.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:09.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:09.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:10.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:10.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:10.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:10.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:11.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:11.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:11.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:11.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:12.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:12.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:12.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:12.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:13.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:13.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:13.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:13.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:14.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:14.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:14.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:14.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:15.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:15.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:15.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:15.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:16.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:16.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:16.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:16.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:17.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:17.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:17.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:17.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:18.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:18.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:18.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:18.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:19.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:19.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:19.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:19.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:20.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:20.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:20.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:20.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:21.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:21.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:21.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:21.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:22.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:22.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:22.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:22.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:23.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:23.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:23.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:23.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:24.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:24.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:24.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:24.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:25.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:25.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:25.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:25.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:26.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:26.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:26.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:26.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:27.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:27.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:27.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:27.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:28.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:28.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:28.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:28.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:29.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:29.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:29.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:29.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:30.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:30.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:30.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:30.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:31.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:31.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:31.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:31.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:32.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:32.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:32.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:32.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:33.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:33.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:33.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:33.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:34.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:34.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:34.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:34.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:35.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:35.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:35.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:35.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:36.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:36.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:36.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:36.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:37.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:37.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:37.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:37.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:38.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:38.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:38.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:38.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:39.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:39.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:39.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:39.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:40.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:40.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:40.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:40.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:41.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:41.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:41.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:41.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:42.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:42.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:42.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:42.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:43.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:43.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:43.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:43.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:44.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:44.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:44.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:44.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:45.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:45.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:45.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:45.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:46.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:46.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:46.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:46.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:47.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:47.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:47.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:47.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:48.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:48.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:48.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:48.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:49.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:49.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:49.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:49.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:50.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:50.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:50.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:50.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:51.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:51.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:51.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:51.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:52.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:52.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:52.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:52.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:53.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:53.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:53.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:53.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:54.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:54.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:54.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:54.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:55.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:55.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:55.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:55.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:56.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:56.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:56.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:56.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:57.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:57.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:57.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:57.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:58.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:58.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:58.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:58.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:59.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:00:59.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:00:59.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:00:59.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:00.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:00.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:00.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:00.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:01.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:01.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:01.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:01.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:02.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:02.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:02.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:02.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:03.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:03.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:03.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:03.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:04.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:04.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:04.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:04.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:05.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:05.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:05.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:05.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:06.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:06.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:06.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:06.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:07.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:07.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:07.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:07.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:08.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:08.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:08.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:08.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:09.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:09.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:09.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:09.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:10.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:10.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:10.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:10.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:11.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:11.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:11.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:11.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:12.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:12.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:12.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:12.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:13.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:13.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:13.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:13.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:14.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:14.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:14.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:14.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:15.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:15.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:15.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:15.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:16.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:16.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:16.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:16.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:17.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:17.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:17.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:17.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:18.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:18.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:18.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:18.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:19.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:19.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:19.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:19.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:20.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:20.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:20.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:20.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:21.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:21.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:21.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:21.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:22.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:22.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:22.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:22.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:23.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:23.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:23.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:23.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:24.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:24.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:24.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:24.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:25.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:25.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:25.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:25.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:26.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:26.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:26.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:26.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:27.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:27.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:27.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:27.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:28.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:28.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:28.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:28.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:29.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:29.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:29.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:29.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:30.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:30.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:30.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:30.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:31.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:31.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:31.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:31.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:32.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:32.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:32.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:32.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:33.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:33.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:33.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:33.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:34.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:34.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:34.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:34.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:35.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:35.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:35.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:35.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:36.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:36.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:36.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:36.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:37.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:37.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:37.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:37.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:38.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:38.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:38.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:38.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:39.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:39.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:39.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:39.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:40.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:40.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:40.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:40.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:41.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:41.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:41.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:41.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:42.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:42.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:42.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:42.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:43.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:43.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:43.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:43.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:44.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:44.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:44.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:44.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:45.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:45.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:45.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:45.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:46.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:46.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:46.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:46.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:47.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:47.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:47.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:47.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:48.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:48.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:48.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:48.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:49.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:49.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:49.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:49.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:50.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:50.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:50.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:50.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:51.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:51.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:51.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:51.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:52.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:52.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:52.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:52.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:53.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:53.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:53.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:53.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:54.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:54.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:54.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:54.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:55.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:55.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:55.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:55.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:56.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:56.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:56.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:56.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:57.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:57.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:57.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:57.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:58.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:58.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:58.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:58.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:59.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:01:59.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:01:59.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:01:59.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:00.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:00.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:00.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:00.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:01.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:01.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:01.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:01.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:02.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:02.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:02.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:02.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:03.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:03.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:03.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:03.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:04.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:04.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:04.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:04.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:05.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:05.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:05.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:05.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:06.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:06.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:06.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:06.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:07.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:07.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:07.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:07.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:08.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:08.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:08.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:08.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:09.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:09.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:09.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:09.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:10.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:10.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:10.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:10.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:11.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:11.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:11.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:11.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:12.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:12.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:12.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:12.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:13.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:13.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:13.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:13.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:14.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:14.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:14.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:14.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:15.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:15.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:15.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:15.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:16.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:16.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:16.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:16.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:17.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:17.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:17.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:17.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:18.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:18.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:18.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:18.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:19.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:19.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:19.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:19.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:20.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:20.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:20.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:20.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:21.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:21.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:21.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:21.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:22.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:22.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:22.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:22.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:23.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:23.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:23.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:23.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:24.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:24.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:24.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:24.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:25.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:25.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:25.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:25.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:26.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:26.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:26.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:26.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:27.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:27.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:27.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:27.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:28.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:28.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:28.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:29.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:29.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:29.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:29.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:29.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:30.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:30.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:30.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:30.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:31.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:31.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:32.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:32.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:32.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:32.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:32.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:33.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:33.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:33.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:33.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:33.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:34.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:34.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:34.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:35.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:35.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:35.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:35.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:35.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:36.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:36.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:36.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:37.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:37.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:37.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:37.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:37.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 21 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:38.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:38.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:38.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:38.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:39.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:39.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:40.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:40.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:40.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:40.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:41.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:41.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:41.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:41.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:42.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:42.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:42.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:42.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:42.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:43.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:43.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:43.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:44.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:44.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:44.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:44.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:45.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:45.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:45.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:45.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:46.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:46.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:46.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:46.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:47.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:47.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:47.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:47.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:48.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:48.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:48.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:48.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:49.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:49.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:49.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:49.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:50.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:50.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:50.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:50.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:51.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:51.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:51.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:51.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:52.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:52.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:52.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:52.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:53.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:53.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:53.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:53.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:54.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:54.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:54.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:54.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:55.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:55.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:55.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:55.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:56.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:56.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:56.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:56.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:57.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:57.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:57.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:57.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:58.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:58.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:58.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:58.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:02:59.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:02:59.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:02:59.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:02:59.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:00.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:00.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:00.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:00.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:01.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:01.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:01.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:01.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:02.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:02.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:02.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:02.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:03.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:03.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:03.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:03.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:03.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:03.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:04.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:04.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:04.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:04.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:05.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:05.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:06.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:06.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:06.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:06.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:06.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:06.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:07.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:07.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:08.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:08.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:03:08.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:08.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:08.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:08.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:09.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:09.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:09.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:09.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:10.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:10.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:10.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:11.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:11.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:11.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:11.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:11.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:12.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:12.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:12.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:12.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:13.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:13.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:13.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:13.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:14.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:14.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:15.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:15.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:15.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:15.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:16.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:16.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:16.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:16.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:17.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:17.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:17.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:17.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:18.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:18.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:18.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:18.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:19.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:19.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:19.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:19.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:20.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:20.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:20.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:20.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:21.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:21.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:21.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:21.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:22.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:22.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:22.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:22.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:22.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:23.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:23.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:23.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:23.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:23.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:24.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:24.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:24.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:24.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:25.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:25.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:25.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:25.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:26.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:26.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:26.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:26.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:27.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:27.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:27.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:27.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:28.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:28.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:28.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:28.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:29.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:29.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:29.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:29.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:30.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:30.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:30.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:30.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:31.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:31.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:31.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:31.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:32.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:32.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:32.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:32.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:33.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:33.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:33.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:33.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:34.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:34.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:34.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:34.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:35.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:35.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:35.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:35.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:36.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:36.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:36.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:36.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:37.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:37.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:37.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:37.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:38.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:38.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:38.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:38.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:39.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:39.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:39.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:39.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:40.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:40.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:40.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:40.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:41.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:41.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:41.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:41.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:42.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:42.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:42.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:42.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:43.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:43.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:43.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:43.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:44.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:44.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:44.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:44.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:45.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:45.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:45.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:45.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:46.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:46.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:46.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:46.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:47.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:47.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:47.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:47.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:48.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:48.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:48.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:48.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:49.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:49.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:49.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:49.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:50.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:50.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:50.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:50.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:51.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:51.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:51.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:51.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:52.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:52.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:52.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:52.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:53.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:53.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:53.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:53.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:54.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:54.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:54.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:54.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:55.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:55.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:55.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:55.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:56.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:56.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:56.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:56.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:57.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:57.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:57.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:57.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:58.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:58.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:58.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:58.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:59.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:03:59.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:03:59.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:03:59.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:00.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:00.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:00.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:00.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:01.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:01.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:01.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:01.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:02.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:02.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:02.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:02.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:03.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:03.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:03.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:03.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:04.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:04.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:04.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:04.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:05.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:05.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:05.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:05.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:06.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:06.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:06.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:06.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:07.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:07.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:07.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:07.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:08.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:08.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:08.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:08.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:09.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:09.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:09.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:09.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:10.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:10.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:10.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:10.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:11.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:11.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:11.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:11.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:12.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:12.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:12.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:12.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:13.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:13.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:13.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:13.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:14.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:14.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:14.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:14.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:15.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:15.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:15.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:15.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:16.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:16.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:16.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:16.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:17.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:17.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:17.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:17.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:18.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:18.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:18.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:18.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:19.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:19.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:19.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:19.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:20.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:20.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:20.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:20.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:21.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:21.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:21.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:21.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:22.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:22.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:22.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:22.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:23.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:23.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:23.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:23.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:24.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:24.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:24.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:24.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:25.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:25.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:25.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:25.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:26.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:26.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:26.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:26.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:27.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:27.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:27.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:27.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:28.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:28.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:28.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:28.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:29.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:29.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:29.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:29.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:30.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:30.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:30.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:30.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:31.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:31.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:31.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:31.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:32.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:32.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:32.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:32.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:33.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:33.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:33.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:33.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:34.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:34.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:34.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:34.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:35.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:35.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:35.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:35.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:36.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:36.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:36.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:36.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:37.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:37.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:37.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:37.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:38.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:38.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:38.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:38.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:39.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:39.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:39.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:39.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:40.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:40.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:40.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:40.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:41.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:41.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:41.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:41.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:42.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:42.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:42.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:42.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:43.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:43.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:43.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:43.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:44.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:44.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:44.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:44.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:45.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:45.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:45.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:45.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:46.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:46.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:46.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:46.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:47.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:47.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:47.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:47.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:48.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:48.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:48.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:48.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:49.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:49.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:49.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:49.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:50.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:50.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:50.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:50.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:51.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:51.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:51.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:51.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:52.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:52.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:52.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:52.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:53.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:53.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:53.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:53.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:54.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:54.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:54.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:54.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:55.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:55.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:55.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:55.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:56.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:56.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:56.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:56.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:57.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:57.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:57.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:57.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:58.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:58.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:58.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:58.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:59.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:04:59.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:04:59.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:04:59.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:00.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:00.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:00.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:00.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:01.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:01.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:01.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:01.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:02.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:02.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:02.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:02.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:03.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:03.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:03.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:03.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:04.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:04.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:04.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:04.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:05.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:05.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:05.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:05.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:06.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:06.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:06.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:06.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:07.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:07.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:07.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:07.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:08.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:08.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:08.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:08.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:09.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:09.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:09.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:09.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:10.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:10.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:10.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:10.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:11.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:11.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:11.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:11.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:12.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:12.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:12.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:12.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:13.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:13.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:13.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:13.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:14.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:14.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:14.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:14.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:15.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:15.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:15.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:15.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:16.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:16.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:16.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:16.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:17.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:17.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:17.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:17.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:18.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:18.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:18.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:18.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:19.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:19.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:19.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:19.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:20.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:20.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:20.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:20.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:21.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:21.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:21.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:21.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:22.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:22.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:22.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:22.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:23.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:23.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:23.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:23.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:24.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:24.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:24.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:24.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:25.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:25.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:25.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:25.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:26.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:26.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:26.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:26.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:27.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:27.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:27.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:27.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:28.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:28.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:28.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:28.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:29.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:29.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:29.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:29.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:30.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:30.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:30.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:30.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:31.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:31.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:31.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:31.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:32.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:32.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:32.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:32.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:33.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:33.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:33.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:33.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:34.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:34.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:34.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:34.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:35.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:35.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:35.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:35.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:36.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:36.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:36.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:36.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:37.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:37.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:37.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:37.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:38.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:38.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:38.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:38.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:39.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:39.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:39.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:39.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:40.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:40.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:41.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:41.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:41.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:41.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:41.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:41.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:42.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:42.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:42.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:42.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:43.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:43.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:43.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:43.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:44.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:44.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:44.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:44.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:45.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:45.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:45.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:45.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:46.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:46.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:46.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:46.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:47.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:47.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:47.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:47.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:48.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:48.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:48.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:48.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:49.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:49.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:49.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:49.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:50.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:50.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:50.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:50.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:51.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:51.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:51.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:51.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:52.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:52.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:52.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:52.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:53.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:53.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:53.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:53.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:54.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:54.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:54.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:54.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:55.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:55.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:55.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:55.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:56.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:56.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:56.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:56.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:57.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:57.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:57.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:57.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:58.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:58.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:58.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:58.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:59.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:05:59.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:05:59.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:05:59.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:00.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:00.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:00.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:00.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:01.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:01.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:01.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:01.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:02.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:02.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:02.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:02.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:03.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:03.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:03.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:03.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:04.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:04.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:04.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:04.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:05.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:05.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:05.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:05.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:06.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:06.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:06.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:06.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:07.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:07.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:07.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:07.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:08.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:08.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:08.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:08.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:09.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:09.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:09.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:09.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:10.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:10.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:10.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:10.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:11.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:11.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:11.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:11.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:12.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:12.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:12.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:12.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:13.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:13.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:13.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:13.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:14.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:14.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:14.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:14.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:15.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:15.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:15.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:15.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:16.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:16.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:16.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:16.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:17.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:17.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:17.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:17.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:18.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:18.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:18.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:18.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:19.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:19.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:19.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:19.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:20.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:20.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:20.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:20.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:21.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:21.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:21.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:21.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:22.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:22.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:22.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:22.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:23.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:23.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:23.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:23.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:24.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:24.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:24.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:24.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:25.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:25.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:25.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:25.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:26.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:26.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:26.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:26.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:27.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:27.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:27.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:27.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:28.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:28.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:28.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:28.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:29.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:29.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:29.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:29.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:30.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:30.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:30.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:30.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:31.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:31.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:31.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:31.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:32.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:32.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:32.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:32.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:33.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:33.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:33.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:33.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:34.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:34.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:34.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:34.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:35.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:35.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:35.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:35.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:36.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:36.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:36.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:36.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:37.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:37.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:37.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:37.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:38.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:38.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:38.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:38.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:39.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:39.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:39.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:39.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:40.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:40.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:40.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:40.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:41.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:41.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:41.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:41.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:42.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:42.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:42.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:42.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:43.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:43.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:43.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:43.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:44.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:44.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:44.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:44.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:45.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:45.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:45.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:45.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:46.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:46.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:46.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:46.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:47.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:47.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:47.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:47.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:48.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:48.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:48.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:48.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:49.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:49.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:49.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:49.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:50.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:50.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:50.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:50.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:51.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:51.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:51.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:51.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:52.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:52.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:52.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:52.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:53.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:53.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:53.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:53.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:54.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:54.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:54.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:54.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:55.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:55.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:55.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:55.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:56.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:56.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:56.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:56.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:57.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:57.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:57.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:57.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:58.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:58.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:58.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:58.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:59.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:06:59.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:06:59.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:06:59.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:00.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:00.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:00.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:00.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:01.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:01.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:01.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:01.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:02.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:02.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:02.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:02.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:02.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:02.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:03.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:03.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:03.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:03.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:04.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:04.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:04.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:04.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:05.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:05.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:05.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:05.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:06.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:06.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:06.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:06.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:07.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:07.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:07.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:07.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:08.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:08.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:08.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:08.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:09.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:09.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:09.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:09.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:10.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:10.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:11.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:11.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:11.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:11.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:12.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:12.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:12.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:12.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:13.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:13.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:13.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:13.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:14.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:14.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:14.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:14.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:15.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:14.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:15.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:15.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:16.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:16.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:16.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:16.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:17.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:17.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:17.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:17.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:18.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:18.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:18.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:18.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:19.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:19.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:19.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:19.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:20.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:20.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:20.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:20.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:21.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:21.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:21.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:21.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:22.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:22.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:22.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:22.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:23.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:23.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:23.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:23.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:23.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:23.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:24.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:24.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:25.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:24.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:25.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:25.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:25.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:25.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:26.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:26.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:26.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:26.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:27.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:27.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:27.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:27.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:28.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:28.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:28.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:28.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:29.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:29.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:29.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:29.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:30.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:30.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:30.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:30.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:31.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:31.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:31.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:31.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:32.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:32.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:32.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:32.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:33.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:33.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:33.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:33.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:34.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:34.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:35.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:34.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:35.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:35.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:36.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:36.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:36.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:36.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:37.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:37.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:37.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:37.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:38.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:38.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:38.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:38.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:39.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:39.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:39.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:39.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:39.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:39.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:40.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:40.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:41.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:41.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:41.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:41.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:42.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:42.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:42.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:42.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:43.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:43.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:43.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:43.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:44.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:44.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:44.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:44.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:45.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:45.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:45.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:45.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:46.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:46.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:46.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:46.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:47.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:47.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:47.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:47.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:48.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:48.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:48.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:48.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:49.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:49.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:49.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:49.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:50.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:50.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:50.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:50.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:51.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:51.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:51.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:51.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:52.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:52.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:52.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:52.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:53.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:53.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:53.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:53.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:54.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:54.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:54.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:54.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:55.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:55.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:55.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:55.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:56.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:55.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:56.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:56.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:57.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:57.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:57.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:57.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:58.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:58.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:58.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:58.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:59.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:07:59.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:07:59.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:07:59.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:00.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:00.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:00.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:00.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:01.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:01.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:01.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:01.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:02.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:02.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:02.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:02.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:03.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:03.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:03.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:03.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:04.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:03.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:04.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:04.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:05.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:04.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:05.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:05.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:06.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:05.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:06.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:06.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:07.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:07.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:07.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:07.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:08.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:08.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:08.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:08.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:08.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:08.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:09.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:09.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:10.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:10.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:10.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:10.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:11.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:11.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:11.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:11.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:12.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:12.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:12.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:12.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:13.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:13.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:13.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:13.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:14.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:14.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:14.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:14.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:15.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:15.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:15.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:15.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:16.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:16.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:16.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:16.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:17.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:17.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:17.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:17.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:18.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:18.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:18.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:18.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:19.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:19.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:19.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:19.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:20.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:20.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:20.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:20.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:21.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:21.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:21.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:21.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:22.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:22.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:22.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:22.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:23.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:23.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:23.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:23.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:24.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:24.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:24.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:24.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:25.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:25.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:25.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:25.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:26.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:26.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:26.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:26.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:27.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:27.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:27.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:27.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:28.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:28.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:28.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:28.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:29.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:29.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:29.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:29.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:30.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:30.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:30.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:30.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:31.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:31.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:31.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:31.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:32.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:32.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:32.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:32.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:33.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:33.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:33.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:33.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:34.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:34.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:34.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:34.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:35.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:35.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:35.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:35.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:36.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:36.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:36.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:36.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:37.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:37.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:37.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:37.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:38.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:38.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:38.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:38.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:39.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:39.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:39.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:39.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:40.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:40.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:40.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:40.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:41.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:41.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:41.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:41.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:42.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:42.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:42.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:42.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:43.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:43.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:43.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:43.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:44.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:44.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:44.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:44.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:45.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:45.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:45.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:45.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:46.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:46.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:46.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:46.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:47.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:47.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:47.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:47.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:48.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:48.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:48.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:48.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:49.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:49.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:49.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:49.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:50.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:50.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:50.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:50.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:51.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:51.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:51.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:51.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:52.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:52.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:52.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:52.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:53.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:53.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:53.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:53.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:54.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:54.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:55.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:54.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:55.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:55.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:56.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:56.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:56.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:56.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:57.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:57.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:57.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:57.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:58.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:58.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:58.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:58.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:59.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:08:59.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:08:59.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:08:59.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:00.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:00.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:00.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:00.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:01.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:01.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:01.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:01.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:02.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:02.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:02.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:02.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:03.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:03.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:03.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:03.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:04.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:04.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:04.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:04.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:05.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:05.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:05.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:05.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:06.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:06.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:06.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:06.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:07.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:07.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:07.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:07.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:08.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:08.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:08.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:08.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:08.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:08.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:09.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:09.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:10.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:09.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:10.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:10.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:11.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:10.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:11.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:11.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:12.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:12.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:12.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:12.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:13.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:12.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:13.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:13.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:14.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:14.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:14.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:14.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:15.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:15.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:15.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:15.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:16.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:16.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:16.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:16.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:17.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:17.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:17.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:17.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:18.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:18.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:18.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:18.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:19.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:19.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:19.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:19.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:20.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:20.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:20.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:20.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:21.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:21.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:21.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:21.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:22.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:22.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:22.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:22.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:23.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:23.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:23.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:23.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:24.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:24.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:24.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:24.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:25.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:25.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:25.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:25.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:26.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:26.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:26.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:26.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:27.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:27.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:27.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:27.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:28.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:28.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:28.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:28.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:29.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:29.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:29.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:29.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:30.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:30.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:30.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:30.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:31.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:31.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:31.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:31.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:32.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:32.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:32.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:32.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:33.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:33.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:33.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:33.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:34.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:34.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:34.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:34.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:35.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:35.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:35.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:35.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:36.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:36.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:36.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:36.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:37.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:37.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:37.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:37.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:38.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:38.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:38.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:38.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:39.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:39.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:39.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:39.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:40.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:40.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:40.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:40.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:41.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:41.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:41.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:41.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:42.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:42.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:42.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:42.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:43.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:43.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:43.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:43.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:44.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:44.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:44.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:44.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:45.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:45.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:45.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:45.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:46.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:46.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:46.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:46.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:47.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:47.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:47.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:47.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:48.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:48.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:48.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:48.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:49.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:49.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:49.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:49.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:50.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:50.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:50.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:50.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:51.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:51.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:51.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:51.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:52.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:52.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:52.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:52.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:53.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:53.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:53.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:53.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:54.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:54.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:54.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:54.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:55.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:55.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:55.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:55.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:56.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:56.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:56.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:56.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:57.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:57.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:57.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:57.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:58.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:58.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:58.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:58.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:59.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:09:59.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:09:59.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:09:59.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:00.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:00.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:00.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:00.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:01.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:01.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:01.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:01.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:02.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:02.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:02.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:02.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:03.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:03.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:03.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:03.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:04.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:04.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:04.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:04.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:05.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:05.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:05.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:05.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:06.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:06.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:06.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:06.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:07.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:07.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:07.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:07.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:08.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:08.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:08.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:08.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:09.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:09.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:09.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:09.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:10.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:10.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:10.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:10.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:11.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:11.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:11.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:11.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:12.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:12.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:12.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:12.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:13.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:13.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:13.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:13.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:14.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:14.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:14.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:14.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:15.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:15.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:15.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:15.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:16.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:16.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:16.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:16.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:17.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:17.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:17.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:17.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:18.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:18.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:18.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:18.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:19.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:19.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:19.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:19.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:20.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:20.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:20.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:20.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:21.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:21.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:21.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:21.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:22.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:22.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:22.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:22.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:23.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:23.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:23.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:23.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:24.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:24.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:24.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:24.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:25.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:25.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:25.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:25.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:26.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:26.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:26.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:26.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:27.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:27.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:27.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:27.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:28.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:28.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:28.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:28.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:29.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:29.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:29.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:29.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:30.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:30.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:30.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:30.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:31.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:31.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:31.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:31.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:32.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:32.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:32.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:32.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:33.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:33.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:33.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:33.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:34.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:34.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:34.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:34.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:35.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:35.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:35.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:35.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:36.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:36.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:36.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:36.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:37.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:37.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:37.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:37.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:38.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:38.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:38.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:38.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:39.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:39.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:39.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:39.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:40.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:40.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:40.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:40.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:41.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:41.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:41.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:41.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:42.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:42.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:42.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:42.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:43.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:43.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:43.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:43.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:44.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:44.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:44.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:44.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:45.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:45.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:45.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:45.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:46.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:46.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:46.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:46.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:47.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:47.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:47.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:47.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:48.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:48.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:48.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:48.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:49.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:49.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:49.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:49.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:50.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:50.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:50.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:50.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:51.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:51.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:51.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:51.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:52.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:52.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:52.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:52.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:53.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:53.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:53.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:53.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:54.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:54.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:54.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:54.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:55.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:55.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:55.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:55.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:56.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:56.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:56.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:56.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:57.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:57.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:57.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:57.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:58.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:58.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:58.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:58.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:59.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:10:59.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:10:59.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:10:59.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:00.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:00.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:00.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:00.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:01.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:01.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:01.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:01.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:02.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:02.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:02.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:02.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:03.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:03.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:03.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:03.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:04.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:04.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:04.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:04.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:05.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:05.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:05.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:05.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:06.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:06.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:06.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:06.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:07.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:07.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:07.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:07.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:08.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:08.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:08.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:08.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:09.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:09.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:09.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:09.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:10.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:10.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:10.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:10.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:11.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:11.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:11.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:11.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:12.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:12.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:12.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:12.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:13.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:13.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:13.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:13.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:14.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:14.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:14.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:14.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:15.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:15.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:15.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:15.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:16.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:16.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:16.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:16.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:17.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:17.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:17.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:17.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:18.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:18.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:18.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:18.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:19.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:19.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:19.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:19.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:20.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:20.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:20.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:20.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:21.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:21.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:21.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:21.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:22.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:22.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:22.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:22.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:23.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:23.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:23.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:23.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:24.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:24.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:24.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:24.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:25.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:25.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:25.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:25.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:26.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:26.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:26.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:26.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:27.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:27.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:27.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:27.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:28.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:28.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:28.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:28.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:29.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:29.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:29.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:29.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:30.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:30.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:30.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:30.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:31.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:31.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:31.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:31.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:32.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:32.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:32.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:32.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:33.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:33.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:33.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:33.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:34.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:34.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:34.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:34.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:35.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:35.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:35.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:35.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:36.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:36.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:36.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:36.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:37.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:37.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:37.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:37.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:38.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:38.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:38.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:38.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:39.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:39.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:39.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:39.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:40.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:40.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:40.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:40.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:41.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:41.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:41.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:41.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:42.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:42.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:42.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:42.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:43.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:43.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:43.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:43.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:44.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:44.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:44.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:44.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:45.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:45.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:45.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:45.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:46.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:46.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:46.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:46.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:47.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:47.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:47.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:47.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:48.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:48.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:48.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:48.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:49.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:49.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:49.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:49.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:50.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:50.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:50.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:50.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:51.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:51.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:51.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:51.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:52.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:52.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:52.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:52.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:53.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:53.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:53.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:53.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:54.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:54.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:54.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:54.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:55.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:55.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:55.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:55.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:56.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:56.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:56.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:56.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:57.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:57.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:57.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:57.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:58.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:58.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:58.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:58.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:59.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:11:59.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:11:59.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:11:59.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:00.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:00.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:00.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:00.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:01.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:01.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:01.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:01.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:02.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:02.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:02.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:02.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:03.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:03.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:03.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:03.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:04.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:04.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:04.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:04.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:05.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:05.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:05.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:05.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:06.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:06.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:06.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:06.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:07.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:07.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:07.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:07.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:08.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:08.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:08.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:08.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:09.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:09.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:09.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:09.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:10.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:10.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:10.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:10.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:11.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:11.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:11.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:11.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:12.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:12.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:12.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:12.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:13.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:13.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:13.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:13.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:14.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:14.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:14.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:14.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:15.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:15.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:15.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:15.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:16.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:16.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:16.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:16.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:17.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:17.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:17.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:17.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:18.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:18.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:18.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:18.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:19.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:19.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:19.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:19.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:20.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:20.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:20.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:20.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:21.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:21.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:21.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:21.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:22.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:22.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:22.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:22.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:23.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:23.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:23.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:23.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:24.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:24.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:24.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:24.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:25.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:25.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:25.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:25.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:26.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:26.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:26.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:26.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:27.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:27.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:27.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:27.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:28.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:28.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:28.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:28.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:29.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:29.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:29.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:29.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:30.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:30.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:30.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:30.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:31.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:31.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:31.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:31.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:32.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:32.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:32.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:32.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:33.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:33.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:33.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:33.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:34.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:34.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:34.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:34.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:35.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:35.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:35.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:35.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:36.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:36.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:36.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:36.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:37.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:37.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:37.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:37.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:38.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:38.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:38.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:38.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:39.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:39.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:39.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:39.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:40.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:40.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:40.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:40.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:41.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:41.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:41.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:41.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:42.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:42.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:42.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:42.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:43.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:43.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:43.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:43.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:44.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:44.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:44.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:44.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:45.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:45.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:45.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:45.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:46.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:46.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:46.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:46.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:47.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:47.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:47.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:47.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:48.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:48.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:48.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:48.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:49.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:49.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:49.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:49.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:50.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:50.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:50.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:50.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:51.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:51.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:51.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:51.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:52.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:52.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:52.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:52.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:53.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:53.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:53.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:53.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:54.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:54.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:54.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:54.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:55.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:55.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:55.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:55.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:56.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:56.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:56.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:56.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:57.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:57.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:57.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:57.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:58.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:58.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:58.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:58.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:59.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:12:59.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:12:59.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:12:59.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:00.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:00.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:00.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:00.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:01.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:01.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:01.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:01.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:02.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:02.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:02.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:02.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:03.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:03.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:03.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:03.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:04.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:04.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:04.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:04.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:05.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:05.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:05.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:05.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:06.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:06.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:06.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:06.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:07.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:07.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:07.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:07.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:08.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:08.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:08.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:08.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:09.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:09.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:09.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:09.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:10.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:10.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:10.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:10.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:11.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:11.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:11.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:11.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:12.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:12.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:12.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:12.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:13.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:13.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:13.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:13.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:14.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:14.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:14.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:14.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:15.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:15.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:15.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:15.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:16.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:16.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:16.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:16.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:17.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:17.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:17.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:17.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:18.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:18.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:18.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:18.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:19.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:19.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:19.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:19.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:20.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:20.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:20.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:20.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:21.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:21.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:21.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:21.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:22.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:22.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:22.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:22.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:23.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:23.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:23.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:23.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:24.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:24.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:24.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:24.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:25.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:25.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:25.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:25.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:26.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:26.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:26.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:26.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:27.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:27.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:27.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:27.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:28.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:28.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:28.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:28.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:29.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:29.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:29.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:29.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:30.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:30.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:30.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:30.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:31.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:31.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:31.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:31.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:32.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:32.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:32.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:32.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:33.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:33.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:33.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:33.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:34.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:34.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:34.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:34.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:35.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:35.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:35.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:35.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:36.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:36.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:36.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:36.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:37.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:37.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:37.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:37.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:38.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:38.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:38.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:38.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:39.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:39.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:39.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:39.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:40.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:40.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:40.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:40.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:41.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:41.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:41.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:41.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:42.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:42.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:42.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:42.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:43.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:43.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:43.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:43.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:44.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:44.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:44.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:44.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:45.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:45.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:45.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:45.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:46.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:46.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:46.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:46.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:47.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:47.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:47.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:47.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:48.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:48.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:48.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:48.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:49.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:49.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:49.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:49.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:50.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:50.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:50.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:50.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:51.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:51.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:51.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:51.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:52.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:52.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:52.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:52.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:53.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:53.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:53.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:53.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:54.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:54.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:54.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:54.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:55.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:55.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:55.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:55.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:56.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:56.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:56.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:56.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:57.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:57.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:57.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:57.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:58.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:58.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:58.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:58.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:59.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:13:59.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:13:59.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:13:59.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:00.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:00.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:00.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:00.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:01.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:01.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:01.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:01.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:02.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:02.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:02.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:02.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:03.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:03.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:03.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:03.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:04.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:04.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:04.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:04.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:05.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:05.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:05.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:05.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:06.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:06.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:06.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:06.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:07.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:07.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:07.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:07.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:08.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:08.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:08.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:08.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:09.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:09.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:09.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:09.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:10.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:10.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:10.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:10.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:11.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:11.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:11.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:11.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:12.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:12.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:12.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:12.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:13.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:13.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:13.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:13.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:14.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:14.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:14.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:14.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:15.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:15.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:15.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:15.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:16.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:16.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:17.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:16.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:17.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:17.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:17.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:17.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:18.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:18.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:18.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:18.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:19.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:19.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:19.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:19.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:20.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:20.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:20.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:20.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:21.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:21.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:21.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:21.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:22.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:22.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:22.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:22.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:23.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:23.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:23.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:23.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:24.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:24.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:24.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:24.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:25.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:25.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:25.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:25.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:26.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:26.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:26.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:26.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:27.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:27.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:27.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:27.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:28.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:28.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:28.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:28.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:29.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:29.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:29.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:29.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:30.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:30.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:30.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:30.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:31.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:31.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:31.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:31.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:32.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:32.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:32.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:32.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:33.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:33.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:33.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:33.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:34.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:34.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:34.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:34.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:35.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:35.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:35.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:35.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:36.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:36.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:36.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:36.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:37.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:37.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:37.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:37.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:38.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:38.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:38.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:38.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:39.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:39.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:39.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:39.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:40.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:40.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:40.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:40.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:41.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:41.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:41.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:41.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:42.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:42.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:42.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:42.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:43.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:43.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:43.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:43.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:44.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:44.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:44.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:44.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:45.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:45.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:45.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:45.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:46.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:46.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:46.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:46.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:47.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:47.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:47.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:47.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:48.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:48.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:48.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:48.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:49.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:49.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:49.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:49.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:50.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:50.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:50.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:50.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:51.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:51.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:51.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:51.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:52.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:52.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:52.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:52.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:53.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:53.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:53.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:53.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:54.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:54.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:54.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:54.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:55.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:55.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:55.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:55.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:56.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:56.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:56.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:56.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:57.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:57.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:57.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:57.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:58.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:58.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:58.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:58.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:59.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:14:59.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:14:59.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:14:59.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:00.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:00.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:00.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:00.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:01.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:01.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:01.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:01.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:02.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:02.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:02.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:02.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:03.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:03.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:03.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:03.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:04.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:04.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:04.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:04.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:05.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:05.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:05.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:05.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:06.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:06.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:06.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:06.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:07.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:07.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:07.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:07.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:08.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:08.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:08.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:08.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:09.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:09.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:09.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:09.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:10.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:10.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:10.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:10.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:11.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:11.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:11.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:11.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:12.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:12.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:12.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:12.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:13.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:13.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:13.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:13.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:14.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:14.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:14.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:14.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:15.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:15.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:15.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:15.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:16.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:16.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:16.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:16.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:17.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:17.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:17.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:17.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:18.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:18.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:18.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:18.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:19.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:19.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:19.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:19.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:20.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:20.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:20.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:20.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:21.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:21.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:21.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:21.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:22.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:22.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:22.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:22.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:23.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:23.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:23.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:23.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:24.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:24.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:24.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:24.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:25.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:25.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:25.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:25.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:26.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:26.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:26.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:26.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:27.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:27.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:27.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:27.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:28.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:28.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:28.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:28.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:29.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:29.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:29.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:29.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:30.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:30.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:30.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:30.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:31.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:31.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:31.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:31.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:32.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:32.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:32.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:32.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 24 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:33.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:33.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:33.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:33.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:34.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:34.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:34.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:34.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:35.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:35.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:35.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:35.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:36.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:36.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:36.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:36.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:37.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:37.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:37.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:37.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:38.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:38.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:38.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:38.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:39.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:39.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:39.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:39.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:40.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:40.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:40.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:40.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:41.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:41.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:41.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:41.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:42.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:42.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:42.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:42.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:43.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:43.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:43.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:43.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:44.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:44.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:44.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:44.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:45.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:45.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:45.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:45.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:46.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:46.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:46.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:46.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:47.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:47.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:47.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:47.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:48.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:48.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:48.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:48.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:49.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:49.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:49.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:49.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:50.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:50.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:50.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:50.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:51.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:51.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:51.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:51.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:52.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:52.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:52.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:52.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:53.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:53.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:53.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:53.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:54.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:54.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:54.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:54.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:55.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:55.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:55.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:55.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:56.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:56.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:56.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:56.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:57.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:57.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:57.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:57.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:58.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:58.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:58.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:58.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:59.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:15:59.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:15:59.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:15:59.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:00.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:00.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:00.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:00.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:01.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:01.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:01.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:01.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:02.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:02.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:02.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:02.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 18 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:03.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:03.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:03.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:03.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:04.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:04.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:04.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:04.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:05.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:05.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:05.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:05.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:06.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:06.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:06.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:06.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:07.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:07.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:07.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:07.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:08.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:08.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:08.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:08.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:09.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:09.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:09.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:09.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:10.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:10.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:10.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:10.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:11.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:11.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:11.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:11.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:12.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:12.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:12.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:12.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:13.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:13.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:13.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:13.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:14.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:14.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:14.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:14.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:15.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:15.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:15.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:15.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:16.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:16.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:16.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:16.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:17.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:17.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:17.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:17.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:18.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:18.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:18.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:18.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:19.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:19.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:19.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:19.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:20.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:20.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:20.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:20.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:21.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:21.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:21.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:21.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:22.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:22.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:22.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:22.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:23.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:23.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:23.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:23.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:24.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:24.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:24.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:24.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:25.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:25.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:25.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:25.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:26.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:26.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:26.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:26.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:27.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:27.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:27.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:27.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:28.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:28.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:28.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:28.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:29.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:29.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:29.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:29.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:30.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:30.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:30.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:30.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:31.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:31.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:31.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:31.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:32.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:32.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:32.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:32.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:33.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:33.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:33.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:33.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:34.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:34.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:34.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:34.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:35.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:35.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:35.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:35.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:36.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:36.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:37.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:36.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:37.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:37.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:37.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:37.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:38.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:38.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:38.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:38.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:39.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:39.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:40.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:39.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:40.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:40.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:41.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:41.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:41.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:41.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:42.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:41.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:42.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:42.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:43.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:42.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:43.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:43.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:44.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:43.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:44.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:44.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:45.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:44.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:45.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:45.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:46.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:45.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:46.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:46.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:47.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:46.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:47.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:47.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:47.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:47.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:48.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:48.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:48.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:48.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:49.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:49.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:49.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:49.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:50.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:50.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:50.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:50.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:51.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:51.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:51.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:51.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:52.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:52.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:52.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:52.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:53.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:53.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:53.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:53.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:54.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:54.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:54.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:54.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:55.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:55.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:55.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:55.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:56.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:56.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:56.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:56.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:57.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:57.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:58.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:57.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:58.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:58.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:59.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:58.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:59.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:16:59.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:16:59.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:16:59.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:00.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:00.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:00.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:00.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:01.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:01.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:02.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:01.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:02.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:02.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:03.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:02.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:03.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:03.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:04.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:03.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:04.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:04.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:05.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:04.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:05.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:05.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:06.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:05.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:06.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:06.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:07.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:06.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:07.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:07.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:08.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:07.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:08.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:08.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:09.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:08.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:09.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:09.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:10.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:09.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:10.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:10.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:11.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:10.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:11.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:11.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:12.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:12.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:12.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:12.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:13.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:13.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:13.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:13.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:14.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:14.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:14.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:14.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:15.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:15.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:15.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:15.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:16.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:16.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:16.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:16.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:17.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:17.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:17.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:17.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:18.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:18.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:18.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:18.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:19.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:19.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:19.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:19.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:20.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:20.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:20.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:20.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:21.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:21.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:21.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:21.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:22.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:22.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:22.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:22.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:23.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:23.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:23.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:23.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:24.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:24.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:24.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:24.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:25.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:25.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:25.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:25.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:26.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:26.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:26.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:26.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:27.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:27.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:27.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:27.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:28.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:28.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:28.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:28.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:29.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:28.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:29.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:29.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:30.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:29.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:30.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:30.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:31.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:30.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:31.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:31.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:31.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:31.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:32.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:32.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:32.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:32.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:33.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:33.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:33.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:33.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:34.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:34.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:34.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:34.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:35.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:35.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:35.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:35.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:36.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:36.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:36.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:36.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:37.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:37.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:37.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:37.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:38.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:38.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:38.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:38.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:39.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:39.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:39.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:39.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:40.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:40.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:40.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:40.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:41.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:41.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:41.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:41.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:42.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:42.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:42.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:42.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:43.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:43.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:43.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:43.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:44.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:44.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:44.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:44.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:45.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:45.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:45.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:45.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:46.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:46.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:46.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:46.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:47.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:47.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:47.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:47.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:48.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:48.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:48.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:48.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:49.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:49.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:49.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:49.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:50.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:50.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:50.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:50.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:51.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:51.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:51.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:51.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:52.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:52.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:52.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:52.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:53.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:53.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:53.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:53.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:54.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:54.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:54.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:54.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:55.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:55.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:55.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:55.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:56.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:56.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:56.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:56.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:57.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:57.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:57.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:57.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:58.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:58.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:58.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:58.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:59.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:17:59.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:17:59.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:17:59.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:00.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:00.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:00.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:00.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:01.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:01.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:01.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:01.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:02.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:02.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:02.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:02.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:03.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:03.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:03.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:03.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:04.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:04.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:04.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:04.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:05.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:05.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:05.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:05.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:06.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:06.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:06.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:06.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:07.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:07.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:07.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:07.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:08.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:08.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:08.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:08.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:09.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:09.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:09.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:09.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:10.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:10.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:10.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:10.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:11.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:11.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:11.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:11.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:12.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:12.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:12.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:12.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:13.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:13.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:13.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:13.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:14.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:14.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:14.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:14.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:15.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:14.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:15.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:15.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:16.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:15.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:16.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:16.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:17.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:17.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:17.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:17.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:18.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:18.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:18.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:18.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:19.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:19.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:19.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:19.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:20.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:20.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:20.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:20.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:21.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:21.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:21.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:21.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:22.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:22.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:22.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:22.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:23.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:23.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:23.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:23.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:24.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:24.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:24.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:24.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:25.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:25.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:25.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:25.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:26.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:26.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:26.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:26.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:27.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:27.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:27.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:27.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:28.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:28.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:28.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:28.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:29.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:29.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:29.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:29.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:30.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:30.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:30.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:30.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:31.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:31.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:31.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:31.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:32.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:32.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:32.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:32.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:33.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:33.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:33.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:33.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:34.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:34.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:34.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:34.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:35.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:35.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:35.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:35.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:36.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:36.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:36.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:36.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:37.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:37.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:37.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:37.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:38.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:38.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:38.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:38.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:39.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:39.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:39.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:39.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:40.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:40.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:40.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:40.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:41.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:41.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:41.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:41.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:42.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:42.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:42.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:42.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:43.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:43.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:43.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:43.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:44.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:44.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:44.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:44.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:45.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:45.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:45.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:45.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:46.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:46.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:46.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:46.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:47.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:47.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:47.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:47.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:48.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:48.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:48.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:48.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:49.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:48.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:49.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:49.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:50.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:49.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:50.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:50.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:51.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:51.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:51.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:51.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:52.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:52.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:52.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:52.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:53.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:53.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:53.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:53.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:54.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:53.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:54.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:54.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:55.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:55.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:55.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:55.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:56.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:56.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:56.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:56.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:57.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:57.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:57.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:57.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:58.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:58.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:58.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:58.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:59.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:18:59.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:18:59.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:18:59.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:00.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:00.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:00.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:00.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:01.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:01.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:01.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:01.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:02.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:02.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:02.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:02.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:03.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:03.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:03.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:03.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:04.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:04.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:04.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:04.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:05.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:05.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:05.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:05.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:06.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:06.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:06.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:06.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:07.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:07.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:07.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:07.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:08.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:08.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:08.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:08.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:09.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:09.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:09.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:09.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:10.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:10.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:10.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:10.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:11.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:11.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:11.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:11.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:12.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:12.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:12.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:12.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:13.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:13.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:13.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:13.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:14.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:14.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:14.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:14.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:15.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:15.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:15.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:15.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:16.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:16.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:16.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:16.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:17.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:17.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:17.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:17.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:18.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:18.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:18.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:18.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:19.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:19.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:19.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:19.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:20.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:20.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:20.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:20.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:21.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:21.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:21.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:21.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:22.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:22.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:22.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:22.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:23.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:23.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:23.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:23.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:24.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:24.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:24.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:24.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:25.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:25.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:25.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:25.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:26.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:26.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:26.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:26.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:27.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:27.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:27.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:27.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:28.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:28.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:28.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:28.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:29.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:29.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:29.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:29.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:30.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:30.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:30.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:30.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:31.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:31.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:31.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:31.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:32.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:32.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:32.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:32.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:33.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:33.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:33.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:33.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:34.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:34.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:34.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:34.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:35.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:34.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:35.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:35.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:36.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:35.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:36.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:36.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:37.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:37.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:37.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:37.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:38.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:38.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:38.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:38.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:39.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:39.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:39.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:39.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:40.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:40.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:40.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:40.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:41.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:41.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:41.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:41.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:42.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:42.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:42.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:42.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:43.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:43.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:43.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:43.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:44.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:44.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:44.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:44.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:45.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:45.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:45.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:45.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:46.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:46.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:46.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:46.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:47.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:47.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:47.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:47.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:48.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:48.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:48.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:48.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:49.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:49.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:49.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:49.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:50.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:50.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:50.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:50.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:51.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:51.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:51.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:51.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:52.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:52.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:52.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:52.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:53.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:53.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:53.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:53.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:54.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:54.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:54.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:54.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:55.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:55.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:55.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:55.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:56.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:56.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:56.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:56.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:57.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:57.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:57.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:57.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:58.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:58.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:58.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:58.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:59.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:19:59.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:19:59.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:19:59.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:00.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:00.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:00.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:00.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:01.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:01.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:01.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:01.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:02.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:02.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:02.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:02.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:03.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:03.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:03.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:03.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:04.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:04.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:04.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:04.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:05.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:05.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:05.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:05.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:06.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:06.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:06.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:06.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:07.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:07.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:07.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:07.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:08.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:08.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:08.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:08.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:09.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:09.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:09.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:09.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:10.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:10.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:10.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:10.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:11.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:11.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:11.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:11.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:12.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:12.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:12.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:12.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:13.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:13.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:13.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:13.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:14.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:14.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:14.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:14.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:15.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:15.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:15.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:15.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:16.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:16.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:16.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:16.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:17.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:17.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:17.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:17.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:18.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:18.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:18.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:18.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:19.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:19.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:19.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:19.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:20.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:20.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:20.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:20.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:21.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:21.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:21.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:21.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:22.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:22.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:22.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:22.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:23.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:23.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:23.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:23.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:24.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:24.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:24.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:24.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:25.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:25.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:25.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:25.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:26.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:26.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:26.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:26.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:27.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:27.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:27.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:27.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:28.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:28.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:28.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:28.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:29.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:29.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:29.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:29.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:30.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:30.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:30.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:30.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:31.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:31.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:31.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:31.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:32.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:32.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:32.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:32.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:33.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:33.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:33.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:33.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:34.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:34.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:34.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:34.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:35.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:35.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:35.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:35.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:36.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:36.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:36.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:36.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:37.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:37.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:37.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:37.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:38.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:38.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:38.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:38.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:39.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:39.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:39.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:39.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:40.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:40.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:40.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:40.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:41.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:41.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:41.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:41.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:42.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:42.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:42.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:42.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:43.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:43.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:43.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:43.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:44.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:44.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:44.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:44.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:45.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:45.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:45.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:45.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:46.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:46.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:46.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:46.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:47.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:47.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:47.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:47.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:48.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:48.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:48.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:48.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:49.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:49.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:49.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:49.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:50.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:50.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:50.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:50.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:51.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:51.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:51.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:51.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:52.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:52.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:52.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:52.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:53.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:53.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:53.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:53.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:54.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:54.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:54.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:54.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:55.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:55.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:55.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:55.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:56.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:56.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:56.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:56.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:57.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:57.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:57.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:57.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:58.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:58.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:58.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:58.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:59.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:20:59.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:20:59.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:20:59.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:00.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:00.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:00.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:00.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:01.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:01.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:01.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:01.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:02.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:02.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:02.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:02.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:03.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:03.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:03.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:03.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:04.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:04.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:04.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:04.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:05.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:05.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:05.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:05.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:06.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:06.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:06.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:06.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:07.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:07.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:07.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:07.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:08.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:08.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:08.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:08.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:09.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:09.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:09.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:09.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:10.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:10.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:10.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:10.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:11.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:11.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:11.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:11.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:12.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:12.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:12.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:12.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:13.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:13.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:13.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:13.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:14.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:14.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:14.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:14.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:15.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:15.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:15.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:15.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:16.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:16.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:16.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:16.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:17.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:17.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:17.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:17.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:18.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:18.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:18.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:18.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:19.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:19.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:19.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:19.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:20.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:20.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:20.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:20.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:21.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:21.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:21.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:21.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:22.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:22.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:22.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:22.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:23.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:23.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:23.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:23.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:24.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:24.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:24.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:24.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:25.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:25.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:25.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:25.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:26.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:26.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:26.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:26.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:27.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:27.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:27.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:27.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:28.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:28.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:28.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:28.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:29.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:29.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:29.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:29.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:30.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:30.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:30.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:30.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:31.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:31.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:31.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:31.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:32.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:32.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:32.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:32.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:33.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:33.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:33.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:33.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:34.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:34.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:34.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:34.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:35.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:35.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:35.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:35.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:36.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:36.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:36.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:36.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:37.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:37.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:37.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:37.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:38.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:38.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:38.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:38.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:39.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:39.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:39.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:39.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:40.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:40.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:40.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:40.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:41.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:41.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:41.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:41.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:42.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:42.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:42.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:42.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:43.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:43.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:43.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:43.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:44.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:44.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:44.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:44.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:45.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:45.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:45.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:45.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:46.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:46.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:46.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:46.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:47.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:47.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:47.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:47.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:48.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:48.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:48.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:48.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:49.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:49.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:49.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:49.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:50.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:50.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:50.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:50.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:51.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:51.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:51.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:51.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:52.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:52.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:52.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:52.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:53.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:53.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:53.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:53.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:54.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:54.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:54.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:54.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:55.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:55.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:55.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:55.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:56.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:56.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:56.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:56.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:57.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:57.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:57.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:57.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:58.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:58.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:58.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:58.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:59.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:21:59.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:21:59.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:21:59.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:00.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:00.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:00.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:00.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:01.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:01.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:01.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:01.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:02.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:02.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:02.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:02.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:03.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:03.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:03.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:03.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:04.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:04.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:04.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:04.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:05.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:05.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:05.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:05.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:06.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:06.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:06.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:06.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:07.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:07.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:07.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:07.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:08.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:08.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:08.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:08.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:09.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:09.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:09.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:09.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:10.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:10.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:10.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:10.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:11.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:11.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:11.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:11.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:12.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:12.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:12.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:12.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:13.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:13.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:13.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:13.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:14.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:14.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:14.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:14.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:15.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:15.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:15.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:15.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:16.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:16.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:16.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:16.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:17.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:17.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:17.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:17.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:18.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:18.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:18.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:18.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:19.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:19.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:19.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:19.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:20.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:20.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:20.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:20.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:21.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:21.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:21.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:21.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:22.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:22.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:22.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:22.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:23.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:23.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:23.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:23.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:24.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:24.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:24.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:24.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:25.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:24.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:25.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:25.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:26.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:26.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:26.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:26.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:27.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:26.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:27.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:27.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:28.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:27.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:28.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:28.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:29.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:29.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:29.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:29.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:30.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:30.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:30.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:30.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:31.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:30.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:31.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:31.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:32.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:32.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:32.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:32.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:33.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:32.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:33.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:33.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:34.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:33.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:34.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:34.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:35.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:34.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:35.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:35.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:36.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:36.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:36.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:36.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:37.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:36.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:37.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:37.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:38.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:38.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:38.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:38.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:39.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:38.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:39.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:39.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:40.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:39.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:40.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:40.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:41.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:40.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:41.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:41.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:42.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:42.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:42.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:42.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:43.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:43.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:43.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:43.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:44.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:44.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:44.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:44.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:45.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:45.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:45.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:45.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:46.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:46.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:46.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:46.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:47.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:47.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:47.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:47.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:48.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:48.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:48.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:48.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:49.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:49.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:49.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:49.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:50.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:50.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:50.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:50.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:51.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:51.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:51.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:51.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:52.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:52.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:52.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:52.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:53.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:53.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:53.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:53.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:54.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:54.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:54.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:54.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:55.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:55.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:55.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:55.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:56.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:56.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:56.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:56.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:57.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:57.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:57.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:57.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:58.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:58.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:58.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:58.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:59.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:22:59.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:22:59.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:22:59.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:00.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:00.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:00.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:00.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:01.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:01.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:01.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:01.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:02.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:02.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:02.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:02.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:03.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:03.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:03.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:03.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:04.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:04.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:04.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:04.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:05.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:05.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:05.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:05.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:06.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:06.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:06.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:06.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:07.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:07.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:07.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:07.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:08.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:08.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:08.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:08.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:09.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:09.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:09.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:09.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:10.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:10.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:10.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:10.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:11.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:11.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:11.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:11.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:12.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:12.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:12.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:12.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:13.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:13.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:13.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:13.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:14.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:14.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:14.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:14.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:15.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:15.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:15.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:15.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:16.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:16.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:16.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:16.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:17.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:17.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:17.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:17.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:18.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:18.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:18.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:18.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:19.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:19.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:19.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:19.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:20.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:20.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:20.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:20.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:21.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:21.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:21.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:21.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:22.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:22.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:22.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:22.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:23.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:23.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:23.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:23.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:24.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:24.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:24.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:24.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:25.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:25.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:25.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:25.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:26.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:26.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:26.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:26.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:27.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:27.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:27.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:27.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:28.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:28.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:28.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:28.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:29.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:29.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:29.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:29.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:30.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:30.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:30.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:30.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:31.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:31.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:31.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:31.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:32.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:32.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:32.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:32.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:33.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:33.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:33.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:33.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:34.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:34.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:34.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:34.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:35.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:35.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:35.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:35.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:36.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:36.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:36.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:36.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:37.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:37.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:37.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:37.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:38.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:38.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:38.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:38.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:39.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:39.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:39.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:39.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:40.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:40.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:40.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:40.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:41.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:41.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:41.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:41.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:42.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:42.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:42.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:42.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:43.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:43.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:43.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:43.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:44.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:44.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:44.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:44.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:45.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:45.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:45.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:45.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:46.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:46.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:46.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:46.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:47.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:47.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:47.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:47.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:48.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:48.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:48.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:48.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:49.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:49.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:49.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:49.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:50.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:50.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:50.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:50.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:51.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:51.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:51.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:51.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:52.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:52.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:52.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:52.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:53.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:53.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:53.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:53.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:54.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:54.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:54.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:54.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:55.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:55.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:55.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:55.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:56.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:56.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:56.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:56.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:57.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:57.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:57.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:57.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:58.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:58.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:58.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:58.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:23:59.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:23:59.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:00.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:23:59.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:00.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:00.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:00.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:00.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:01.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:01.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:01.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:01.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:02.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:02.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:02.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:02.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:03.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:03.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:03.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:03.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:04.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:04.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:05.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:04.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:05.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:05.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:06.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:05.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:06.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:06.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:07.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:06.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:07.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:07.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:08.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:07.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:08.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:08.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:09.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:08.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:09.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:09.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:10.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:09.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:10.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:10.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:11.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:10.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:11.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:11.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:12.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:12.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:12.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:12.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:13.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:13.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:13.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:13.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:14.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:14.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:14.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:14.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:15.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:15.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:15.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:15.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:16.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:16.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:16.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:16.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:17.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:17.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:17.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:17.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:18.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:18.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:18.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:18.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:19.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:19.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:19.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:19.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:20.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:20.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:20.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:20.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:21.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:21.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:21.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:21.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:22.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:22.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:22.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:22.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:23.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:23.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:23.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:23.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:24.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:24.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:24.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:24.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:25.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:25.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:25.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:25.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:26.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:26.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:26.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:26.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:27.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:26.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:27.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:27.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:28.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:27.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:28.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:28.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:29.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:28.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:29.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:29.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:30.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:29.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:30.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:30.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:30.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:30.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:31.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:31.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:31.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:31.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:32.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:32.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:33.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:32.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:33.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:33.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:34.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:33.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:34.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:34.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:35.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:34.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:35.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:35.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:36.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:35.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:36.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:36.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:37.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:36.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:37.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:37.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:38.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:37.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:38.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:38.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:39.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:38.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:39.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:39.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:40.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:39.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:40.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:40.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:40.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:40.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:41.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:41.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:41.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:41.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:42.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:42.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:42.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:42.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:43.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:43.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:43.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:43.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:44.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:44.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:45.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:44.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:45.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:45.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:45.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:45.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:46.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:46.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:46.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:46.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:47.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:47.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:47.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:47.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:48.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:48.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:48.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:48.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:49.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:49.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:49.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:49.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:50.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:50.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:50.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:50.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:51.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:51.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:52.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:51.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:52.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:52.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:53.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:52.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:53.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:53.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:54.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:53.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:54.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:54.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:55.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:54.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:55.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:55.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:56.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:55.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:56.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:56.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:56.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:56.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:57.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:57.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:58.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:57.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:58.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:58.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:59.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:58.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:24:59.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:24:59.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:00.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:24:59.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:00.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:00.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:01.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:00.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:01.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:01.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:02.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:01.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:02.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:02.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:03.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:02.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:03.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:03.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:04.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:03.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:04.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:04.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:05.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:04.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:05.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:05.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:06.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:05.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:06.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:06.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:07.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:06.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:07.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:07.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:08.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:07.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:08.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:08.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:09.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:08.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:09.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:09.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:10.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:09.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:10.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:10.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:11.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:11.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:11.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:11.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:12.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:12.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:12.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:12.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:13.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:13.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:13.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:13.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:14.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:14.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:14.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:14.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:15.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:15.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:15.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:15.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:16.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:15.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:16.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:16.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:17.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:16.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:17.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:17.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:18.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:17.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:18.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:18.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:19.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:18.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:19.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:19.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:20.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:19.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:20.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:20.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:21.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:20.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:21.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:21.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:22.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:21.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:22.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:22.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:23.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:23.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:23.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:23.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:24.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:23.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:24.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:24.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:25.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:24.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:25.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:25.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:26.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:26.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:26.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:26.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:27.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:27.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:27.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:27.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:28.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:28.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:28.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:28.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:29.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:29.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:29.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:29.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:30.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:30.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:30.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:30.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:31.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:31.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:31.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:31.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:32.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:32.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:32.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:32.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:33.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:33.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:33.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:33.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:34.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:34.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:34.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:34.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:35.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:35.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:35.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:35.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:36.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:36.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:36.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:36.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:37.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:37.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:37.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:37.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:38.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:38.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:38.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:38.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:39.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:39.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:39.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:39.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:40.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:40.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:40.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:40.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:41.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:41.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:41.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:41.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:42.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:41.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:42.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:42.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:43.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:42.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:43.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:43.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:44.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:44.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:44.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:44.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:45.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:45.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:45.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:45.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:46.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:46.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:46.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:46.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:47.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:46.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:47.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:47.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:48.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:47.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:48.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:48.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:49.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:49.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:49.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:49.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:50.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:50.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:50.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:50.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:51.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:50.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:51.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:51.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:52.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:52.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:52.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:52.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:53.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:53.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:53.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:53.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:54.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:54.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:54.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:54.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:55.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:55.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:55.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:55.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:56.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:56.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:56.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:56.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:57.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:57.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:57.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:57.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:58.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:58.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:58.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:58.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:59.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:25:59.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:25:59.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:25:59.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:00.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:00.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:00.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:00.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:01.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:01.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:01.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:01.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:02.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:02.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:02.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:02.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:03.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:03.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:03.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:03.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:04.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:04.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:04.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:04.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:05.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:05.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:05.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:05.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:06.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:06.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:06.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:06.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:07.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:07.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:07.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:07.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:08.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:08.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:08.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:08.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:09.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:09.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:09.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:09.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:10.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:10.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:10.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:10.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:11.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:11.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:11.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:11.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:12.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:12.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:12.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:12.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:13.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:13.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:13.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:13.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:14.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:14.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:14.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:14.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:15.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:15.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:15.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:15.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:16.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:16.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:16.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:16.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:17.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:17.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:17.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:17.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:18.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:18.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:18.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:18.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:19.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:19.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:19.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:19.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:20.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:20.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:20.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:20.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:21.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:21.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:21.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:21.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:22.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:22.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:22.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:22.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:23.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:23.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:23.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:23.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:24.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:24.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:24.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:24.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:25.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:25.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:25.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:25.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:26.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:26.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:26.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:26.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:27.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:27.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:27.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:27.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:28.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:28.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:28.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:28.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:29.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:29.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:29.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:29.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:30.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:30.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:30.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:30.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:31.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:31.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:31.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:31.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:32.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:32.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:32.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:32.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:33.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:33.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:33.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:33.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:34.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:34.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:34.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:34.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:35.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:35.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:35.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:35.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:36.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:36.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:36.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:36.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:37.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:37.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:37.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:37.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:38.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:38.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:38.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:38.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:39.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:39.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:39.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:39.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:40.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:40.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:40.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:40.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:41.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:41.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:41.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:41.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:42.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:42.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:42.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:42.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:43.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:43.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:43.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:43.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:44.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:44.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:44.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:44.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:45.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:45.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:45.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:45.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:46.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:46.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:46.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:46.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:47.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:47.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:47.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:47.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:48.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:48.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:48.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:48.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:49.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:49.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:49.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:49.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:50.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:50.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:50.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:50.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:51.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:51.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:51.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:51.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:52.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:52.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:52.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:52.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:53.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:53.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:53.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:53.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:54.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:54.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:54.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:54.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:55.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:55.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:55.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:55.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:56.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:56.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:56.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:56.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:57.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:57.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:57.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:57.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:58.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:58.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:58.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:58.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:59.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:26:59.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:26:59.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:26:59.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:00.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:00.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:00.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:00.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:01.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:01.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:01.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:01.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:02.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:02.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:02.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:02.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:03.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:03.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:03.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:03.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:04.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:04.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:04.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:04.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:05.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:05.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:05.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:05.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:06.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:06.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:06.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:06.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:07.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:07.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:07.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:07.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:08.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:08.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:08.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:08.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:09.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:09.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:09.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:09.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:10.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:10.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:10.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:10.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:11.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:11.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:11.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:11.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:12.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:12.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:12.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:12.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:13.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:13.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:13.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:13.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:14.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:14.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:14.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:14.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:15.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:15.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:15.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:15.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:16.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:16.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:16.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:16.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:17.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:17.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:17.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:17.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:18.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:18.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:18.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:18.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:19.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:19.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:19.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:19.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:20.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:20.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:20.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:20.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:21.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:21.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:21.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:21.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:22.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:22.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:22.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:22.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:23.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:23.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:23.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:23.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:24.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:24.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:24.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:24.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:25.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:25.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:25.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:25.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:26.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:26.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:26.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:26.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:27.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:27.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:27.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:27.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:28.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:28.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:28.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:28.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:29.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:29.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:29.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:29.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:30.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:30.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:30.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:30.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:31.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:31.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:31.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:31.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:32.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:32.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:32.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:32.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:33.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:33.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:33.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:33.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:34.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:34.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:34.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:34.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:35.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:35.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:35.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:35.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:36.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:36.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:36.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:36.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:37.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:37.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:37.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:37.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:38.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:38.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:38.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:38.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:39.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:39.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:39.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:39.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:40.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:40.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:40.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:40.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:41.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:41.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:41.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:41.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:42.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:42.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:42.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:42.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:43.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:43.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:43.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:43.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:44.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:44.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:44.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:44.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:45.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:45.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:45.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:45.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:46.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:46.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:46.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:46.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:47.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:47.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:47.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:47.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:48.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:48.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:48.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:48.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:49.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:49.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:49.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:49.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:50.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:50.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:50.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:50.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:51.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:51.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:51.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:51.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:52.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:52.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:52.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:52.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:53.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:53.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:53.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:53.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:54.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:54.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:54.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:54.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:55.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:55.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:55.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:55.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:56.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:56.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:56.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:56.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:57.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:57.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:57.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:57.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:58.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:58.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:58.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:58.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:59.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:27:59.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:27:59.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:27:59.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:00.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:00.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:00.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:00.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:01.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:01.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:01.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:01.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:02.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:02.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:02.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:02.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:03.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:03.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:03.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:03.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:04.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:04.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:04.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:04.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:05.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:05.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:05.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:05.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:06.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:06.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:06.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:06.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:07.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:07.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:07.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:07.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:08.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:08.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:08.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:08.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:09.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:09.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:09.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:09.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:10.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:10.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:10.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:10.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:11.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:11.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:11.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:11.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:12.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:12.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:12.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:12.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:13.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:13.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:13.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:13.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:14.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:14.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:14.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:14.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:15.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:15.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:15.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:15.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:16.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:16.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:16.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:16.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:17.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:17.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:17.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:17.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:18.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:18.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:18.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:18.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:19.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:19.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:19.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:19.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:20.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:20.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:20.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:20.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:21.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:21.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:21.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:21.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:22.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:22.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:22.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:22.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:23.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:23.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:23.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:23.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:24.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:24.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:24.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:24.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:25.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:24.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:25.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:25.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:26.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:25.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:26.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:26.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:27.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:26.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:27.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:27.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:28.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:27.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:28.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:28.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:29.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:28.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:29.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:29.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:30.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:29.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:30.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:30.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:31.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:30.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:31.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:31.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:32.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:31.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:32.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:32.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:33.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:32.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:33.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:33.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:34.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:33.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:34.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:34.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:34.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:34.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:35.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:35.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:36.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:35.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:36.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:36.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:37.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:36.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:37.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:37.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:38.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:37.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:38.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:38.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:39.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:38.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:39.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:39.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:40.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:39.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:40.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:40.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:41.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:40.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:41.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:41.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:42.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:41.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:42.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:42.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:43.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:42.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:43.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:43.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:44.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:43.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:44.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:44.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:44.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:44.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:45.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:45.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:45.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:45.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:46.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:46.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:46.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:46.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:47.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:47.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:47.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:47.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:48.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:48.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:48.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:48.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:49.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:49.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:49.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:49.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:50.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:50.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:50.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:50.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:51.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:51.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:51.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:51.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:52.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:52.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:52.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:52.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:53.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:53.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:53.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:53.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:54.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:53.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:54.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:54.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:55.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:54.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:55.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:55.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:56.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:55.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:56.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:56.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:57.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:56.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:57.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:57.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:58.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:57.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:58.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:58.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:59.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:58.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:59.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:28:59.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:28:59.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:28:59.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:00.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:00.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:01.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:00.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:01.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:01.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:02.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:01.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:02.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:02.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:03.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:02.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:03.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:03.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:04.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:04.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:04.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:04.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:05.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:04.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:05.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:05.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:06.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:05.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:06.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:06.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:07.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:06.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:07.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:07.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:08.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:07.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:08.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:08.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:08.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:08.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:09.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:09.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:09.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:09.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:10.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:10.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:10.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:10.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:11.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:11.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:11.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:11.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:12.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:12.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:13.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:12.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:13.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:13.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:14.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:13.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:14.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:14.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:15.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:14.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:15.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:15.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:16.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:15.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:16.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:16.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:17.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:16.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:17.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:17.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:18.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:18.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:18.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:18.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:19.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:19.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:19.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:19.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:20.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:19.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:20.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:20.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:21.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:20.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:21.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:21.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:22.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:21.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:22.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:22.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:22.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:22.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:23.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:23.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:24.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:23.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:24.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:24.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:24.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:24.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:25.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:25.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:25.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:25.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:26.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:26.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:26.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:26.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:27.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:27.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:27.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:27.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:28.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:28.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:28.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:28.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:29.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:29.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:29.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:29.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:30.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:30.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:30.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:30.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:31.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:31.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:31.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:31.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:32.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:32.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:32.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:32.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:33.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:33.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:33.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:33.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:34.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:34.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:34.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:34.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:35.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:35.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:35.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:35.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:36.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:36.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:36.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:36.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:37.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:37.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:37.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:37.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:38.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:38.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:38.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:38.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:39.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:39.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:39.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:39.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:40.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:40.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:40.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:40.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:41.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:41.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:41.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:41.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:42.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:42.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:42.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:42.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:43.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:43.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:43.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:43.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:44.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:44.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:44.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:44.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:45.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:45.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:45.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:45.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:46.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:46.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:46.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:46.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:47.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:47.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:48.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:47.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:48.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:48.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:49.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:48.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:49.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:49.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:50.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:49.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:50.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:50.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:51.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:50.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:51.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:51.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:52.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:51.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:52.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:52.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:53.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:52.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:53.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:53.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:54.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:54.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:54.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:54.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:55.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:55.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:55.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:55.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:56.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:56.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:56.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:56.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:57.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:57.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:57.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:57.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:58.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:58.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:58.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:58.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:59.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:58.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:29:59.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:29:59.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:00.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:29:59.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:00.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:00.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:01.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:01.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:01.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:01.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:02.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:01.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:02.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:02.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:03.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:03.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:03.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:03.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:04.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:04.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:04.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:04.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:05.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:05.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:05.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:05.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:06.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:06.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:06.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:06.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:07.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:07.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:07.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:07.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:08.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:08.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:08.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:08.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:09.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:09.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:09.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:09.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:10.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:10.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:10.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:10.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:11.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:11.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:11.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:11.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:12.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:12.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:12.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:12.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:13.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:13.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:13.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:13.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:14.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:14.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:14.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:14.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:15.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:15.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:15.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:15.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:16.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:16.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:16.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:16.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:17.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:17.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:17.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:17.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:18.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:18.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:18.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:18.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:19.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:19.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:19.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:19.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:20.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:20.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:20.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:20.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:21.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:21.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:21.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:21.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:22.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:22.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:22.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:22.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:23.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:23.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:23.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:23.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:24.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:24.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:24.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:24.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:25.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:25.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:25.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:25.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:26.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:26.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:26.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:26.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:27.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:27.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:27.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:27.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:28.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:28.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:28.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:28.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:29.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:29.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:29.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:29.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:30.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:30.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:30.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:30.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:31.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:31.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:31.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:31.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:32.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:32.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:32.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:32.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:33.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:33.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:33.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:33.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:34.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:34.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:34.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:34.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:35.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:35.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:35.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:35.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:36.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:36.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:36.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:36.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:37.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:37.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:37.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:37.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:38.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:38.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:38.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:38.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:39.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:39.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:39.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:39.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:40.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:40.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:40.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:40.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:41.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:41.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:41.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:41.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:42.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:42.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:42.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:42.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:43.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:43.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:43.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:43.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:44.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:44.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:44.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:44.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:45.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:45.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:45.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:45.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:46.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:46.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:46.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:46.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:47.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:47.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:47.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:47.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:48.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:48.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:48.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:48.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:49.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:49.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:49.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:49.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:50.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:50.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:50.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:50.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:51.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:51.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:51.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:51.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:52.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:52.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:52.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:52.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:53.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:53.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:53.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:53.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:54.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:54.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:54.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:54.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:55.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:55.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:55.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:55.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:56.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:56.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:56.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:56.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:57.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:57.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:57.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:57.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:58.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:58.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:58.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:58.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:30:59.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:30:59.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:30:59.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:30:59.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:31:00.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:00.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:00.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:00.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:31:01.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:01.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:01.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:01.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:31:02.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:02.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:02.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:02.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T17:31:03.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:03.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:03.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:03.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:04.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:04.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:04.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:04.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:05.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:05.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:05.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:05.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:06.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:06.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:06.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:06.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:07.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:07.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:07.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:07.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:08.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:08.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:08.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:08.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:09.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:09.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:09.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:09.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:10.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:10.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:10.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:10.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:11.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:11.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:11.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:11.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:12.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:12.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:12.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:12.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:13.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:13.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:13.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:13.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:14.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:14.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:14.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:14.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:15.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:15.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:15.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:15.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:16.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:16.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:16.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:16.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:17.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:17.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:17.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:17.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:18.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:18.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:18.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:18.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:19.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:19.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:19.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:19.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:20.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:20.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:20.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:20.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:21.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:21.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:21.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:21.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:22.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:22.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:22.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:22.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:23.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:23.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:23.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:23.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:24.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:24.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:24.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:24.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:25.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:25.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:25.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:25.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:26.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:26.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:26.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:26.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:27.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:27.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:27.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:27.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:28.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:28.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:28.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:28.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:29.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:29.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:29.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:29.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:30.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:30.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:30.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:30.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:31.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:31.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:31.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:31.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:32.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:32.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:32.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:32.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:33.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:33.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:33.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:33.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:34.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:34.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:34.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:34.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:35.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:35.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:35.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:35.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:36.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:36.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:36.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:36.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:37.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:37.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:37.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:37.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:38.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:38.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:38.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:38.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:39.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:39.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:39.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:39.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:40.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:40.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:40.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:40.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:41.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:41.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:41.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:41.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:42.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:42.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:42.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:42.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:43.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:43.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:43.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:43.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:44.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:44.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:44.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:44.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:45.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:45.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:45.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:45.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:46.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:46.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:46.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:46.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:47.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:47.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:47.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:47.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:48.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:48.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:48.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:48.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:49.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:49.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:49.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:49.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:50.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:50.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:50.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:50.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:51.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:51.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:51.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:51.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:52.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:52.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:52.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:52.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:53.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:53.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:53.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:53.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:54.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:54.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:54.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:54.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:55.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:55.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:55.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:55.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:56.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:56.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:56.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:56.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:57.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:57.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:57.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:57.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:58.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:58.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:58.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:58.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:59.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:31:59.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:31:59.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:31:59.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:00.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:00.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:00.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:00.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:01.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:01.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:01.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:01.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:02.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:02.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:02.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:02.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:03.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:03.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:03.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:03.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:04.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:04.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:04.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:04.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:05.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:05.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:05.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:05.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:06.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:06.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:06.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:06.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:07.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:07.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:07.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:07.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:08.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:08.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:08.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:08.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:09.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:09.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:09.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:09.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:10.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:10.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:10.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:10.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:11.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:11.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:11.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:11.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:12.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:12.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:12.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:12.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:13.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:13.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:13.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:13.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:14.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:14.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:14.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:14.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:15.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:15.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:15.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:15.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:16.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:16.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:16.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:16.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:17.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:17.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:17.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:17.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:18.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:18.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:18.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:18.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:19.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:19.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:19.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:19.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:20.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:20.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:20.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:20.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:21.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:21.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:21.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:21.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:22.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:22.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:22.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:22.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:23.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:23.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:23.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:23.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:24.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:24.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:24.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:24.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:25.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:25.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:25.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:25.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:26.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:26.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:26.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:26.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:27.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:27.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:27.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:27.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:28.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:28.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:28.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:28.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:29.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:29.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:29.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:29.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:30.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:30.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:30.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:30.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:31.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:31.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:31.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:31.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:32.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:32.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:32.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:32.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:33.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:33.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:33.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:33.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:34.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:34.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:34.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:34.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:35.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:35.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:35.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:35.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:36.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:36.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:36.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:36.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:37.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:37.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:37.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:37.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:38.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:38.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:38.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:38.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:39.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:39.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:39.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:39.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:40.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:40.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:40.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:40.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:41.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:41.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:41.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:41.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:42.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:42.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:42.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:42.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:43.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:43.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:43.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:43.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:44.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:44.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:44.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:44.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:45.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:45.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:45.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:45.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:46.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:46.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:46.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:46.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:47.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:47.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:47.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:47.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:48.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:48.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:48.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:48.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:49.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:49.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:49.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:49.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:50.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:50.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:50.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:50.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:51.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:51.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:51.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:51.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:52.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:52.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:52.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:52.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:53.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:53.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:53.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:53.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:54.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:54.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:54.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:54.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:55.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:55.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:55.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:55.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:56.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:56.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:56.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:56.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:57.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:57.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:57.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:57.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:58.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:58.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:58.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:58.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:59.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:32:59.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:32:59.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:32:59.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:00.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:00.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:00.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:00.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:01.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:01.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:01.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:01.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:02.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:02.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:02.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:02.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:03.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:03.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:03.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:03.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:04.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:04.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:04.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:04.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:05.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:05.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:05.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:05.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:06.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:06.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:06.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:06.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:07.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:07.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:07.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:07.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:08.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:08.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:08.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:08.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:09.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:09.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:09.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:09.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:10.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:09.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:10.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:10.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:10.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:10.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:11.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:11.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:11.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:11.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:12.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:12.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:12.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:12.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:13.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:13.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:13.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:13.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:14.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:14.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:14.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:14.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:15.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:15.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:15.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:15.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:16.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:16.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:17.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:16.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:17.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:17.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:18.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:18.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:18.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:18.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:19.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:19.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:19.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:19.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:20.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:20.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:20.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:20.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:21.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:21.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:21.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:21.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:22.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:22.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:22.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:22.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:23.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:23.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:23.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:23.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:24.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:24.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:24.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:24.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:25.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:25.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:25.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:25.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:26.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:26.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:26.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:26.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:27.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:27.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:27.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:27.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:28.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:28.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:28.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:28.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:29.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:29.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:29.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:29.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:30.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:30.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:30.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:30.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:31.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:31.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:31.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:31.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:32.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:32.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:32.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:32.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:33.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:33.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:33.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:33.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:34.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:33.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:34.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:34.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:35.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:34.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:35.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:35.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:35.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:35.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:36.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:36.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:36.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:36.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:37.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:37.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:37.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:37.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:38.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:38.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:38.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:38.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:39.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:39.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:39.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:39.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:40.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:40.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:40.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:40.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:41.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:41.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:41.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:41.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:42.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:42.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:42.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:42.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:43.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:43.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:43.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:43.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:44.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:44.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:44.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:44.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:45.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:45.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:45.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:45.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:46.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:46.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:46.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:46.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:47.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:47.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:47.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:47.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:48.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:48.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:48.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:48.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:49.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:49.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:49.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:49.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:50.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:50.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:50.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:50.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:51.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:51.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:51.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:51.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:52.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:52.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:52.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:52.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:53.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:53.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:53.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:53.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:54.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:54.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:54.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:54.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:55.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:55.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:55.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:55.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:56.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:56.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:56.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:56.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:57.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:57.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:57.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:57.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:58.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:58.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:58.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:58.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:59.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:33:59.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:33:59.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:33:59.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:00.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:00.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:00.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:00.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:01.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:01.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:01.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:01.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:02.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:02.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:02.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:02.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:03.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:03.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:03.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:03.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:04.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:04.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:04.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:04.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:05.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:05.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:06.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:06.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:06.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:06.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:07.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:06.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:07.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:07.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:08.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:08.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:08.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:08.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:08.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:08.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:09.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:09.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:09.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:09.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:10.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:10.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:10.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:10.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:11.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:11.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:11.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:11.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:12.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:12.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:12.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:12.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:13.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:13.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:13.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:13.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:14.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:14.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:14.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:14.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:15.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:15.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:15.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:15.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:16.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:16.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:16.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:16.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:17.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:17.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:17.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:17.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:18.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:18.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:19.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:19.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:19.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:19.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:19.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:19.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:20.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:20.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:20.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:20.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:21.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:21.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:21.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:21.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:22.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:22.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:22.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:22.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:23.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:23.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:23.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:23.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:24.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:24.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:24.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:24.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:25.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:25.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:25.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:25.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:26.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:26.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:26.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:26.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:27.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:27.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:27.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:27.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:28.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:28.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:28.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:28.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:29.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:29.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:29.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:29.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:30.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:30.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:30.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:30.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:31.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:31.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:31.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:31.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:32.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:32.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:33.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:32.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:33.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:33.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:34.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:34.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:34.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:34.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:35.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:35.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:35.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:35.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:36.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:36.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:36.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:36.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:37.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:37.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:37.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:37.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:38.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:38.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:38.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:38.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:39.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:38.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:39.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:39.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:39.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:39.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:40.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:40.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:40.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:40.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:41.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:41.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:41.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:41.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:42.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:42.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:42.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:42.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:43.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:43.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:43.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:43.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:44.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:44.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:44.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:44.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:45.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:45.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:45.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:45.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:46.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:46.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:46.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:46.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:47.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:47.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:47.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:47.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:48.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:48.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:48.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:48.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:49.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:49.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:49.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:49.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:50.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:50.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:50.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:50.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:51.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:51.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:51.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:51.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:52.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:52.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:52.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:52.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:53.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:53.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:53.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:53.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:54.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:54.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:54.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:54.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:55.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:55.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:55.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:55.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:56.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:56.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:56.896 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T17:34:56.893+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x55ddecea29e0 msgr2=0x7f81ac0408e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T17:34:56.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:56.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:57.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:57.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:57.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:57.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:58.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:58.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:58.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:58.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:59.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:34:59.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:34:59.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:34:59.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:00.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:00.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:00.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:00.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:01.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:01.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:01.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:01.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:02.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:02.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:02.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:02.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:03.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:03.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:03.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:03.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:04.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:04.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:04.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:04.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:05.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:05.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:05.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:05.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:06.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:06.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:06.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:06.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:07.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:07.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:08.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:08.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:08.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:08.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:09.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:09.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:09.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:09.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:10.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:10.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:10.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:10.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:10.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:10.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:11.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:11.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:12.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:12.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:12.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:12.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:12.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:12.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:13.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:13.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:13.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:13.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:14.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:14.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:14.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:14.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:15.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:15.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:15.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:15.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:16.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:16.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:16.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:16.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:17.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:17.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:17.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:17.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:18.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:18.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:18.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:18.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:19.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:19.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:19.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:19.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:20.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:20.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:20.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:20.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:21.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:21.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:21.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:21.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:22.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:22.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:22.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:22.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:23.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:23.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:23.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:23.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:24.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:24.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:24.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:24.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:25.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:25.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:25.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:25.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:26.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:26.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:26.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:26.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:27.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:27.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:27.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:27.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:28.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:28.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:28.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:28.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:29.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:29.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:29.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:29.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:30.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:30.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:30.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:30.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:31.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:31.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:31.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:31.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:32.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:32.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:32.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:32.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:33.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:33.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:33.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:33.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:34.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:34.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:34.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:34.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:35.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:35.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:35.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:35.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:36.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:36.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:36.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:36.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:37.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:37.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:37.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:37.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:38.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:38.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:38.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:38.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:39.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:39.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:39.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:39.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:40.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:40.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:40.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:40.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:41.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:41.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:42.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:42.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:42.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:42.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:43.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:43.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:43.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:43.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:44.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:44.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:44.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:44.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:44.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:45.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:45.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:45.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:45.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:45.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:46.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:46.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:47.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:47.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:47.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:47.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:48.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:48.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:48.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:48.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:49.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:49.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:49.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:49.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:50.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:50.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:50.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:50.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:51.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:51.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:51.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:51.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:52.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:52.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:52.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:52.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:53.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:53.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:53.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:53.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:54.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:54.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:54.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:54.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:55.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:55.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:55.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:55.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:56.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:56.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:56.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:56.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:57.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:57.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:57.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:57.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:58.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:58.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:58.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:58.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:59.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:35:59.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:35:59.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:35:59.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:00.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:00.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:00.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:00.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:00.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:00.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:01.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:01.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:01.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:01.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:02.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:02.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:02.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:02.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:02.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:02.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:03.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:03.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:03.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:03.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:04.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:04.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:04.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:04.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:05.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:05.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:05.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:05.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:06.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:06.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:07.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:07.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:07.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:07.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:08.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:08.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:08.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:08.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:09.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:09.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:09.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:09.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:10.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:10.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:10.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:10.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:11.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:11.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:11.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:11.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:12.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:12.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:12.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:12.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:13.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:13.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:13.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:13.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:14.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:14.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:14.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:14.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:15.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:15.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:15.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:15.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:16.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:16.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:16.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:16.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:17.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:17.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:17.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:17.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:18.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:18.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:18.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:18.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:19.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:19.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:19.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:19.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:20.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:20.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:20.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:20.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:21.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:21.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:21.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:21.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:22.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:22.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:22.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:22.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:23.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:23.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:23.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:23.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:24.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:24.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:24.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:24.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:25.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:25.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:25.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:25.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:26.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:26.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:26.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:26.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:27.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:27.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:27.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:27.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:28.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:28.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:28.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:28.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:29.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:29.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:29.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:29.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:30.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:30.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:30.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:30.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:30.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:30.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:31.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:31.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:32.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:32.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:32.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:32.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:33.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:33.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:33.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:33.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:34.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:34.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:34.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:34.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:35.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:35.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:35.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:35.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:36.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:36.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:36.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:36.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:37.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:37.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:37.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:37.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:38.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:38.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:38.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:38.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:39.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:39.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:39.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:39.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:40.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:40.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:40.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:40.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:41.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:41.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:41.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:41.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:42.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:42.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:42.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:42.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:43.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:43.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:43.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:43.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:44.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:44.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:44.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:44.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:45.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:45.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:45.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:45.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:46.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:46.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:46.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:46.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:47.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:47.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:47.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:47.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:48.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:48.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:48.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:48.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:49.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:49.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:49.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:49.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:50.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:50.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:50.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:50.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:51.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:51.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:51.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:51.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:52.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:52.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:52.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:52.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:53.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:53.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:53.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:53.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:54.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:54.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:54.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:54.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:55.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:55.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:55.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:55.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:56.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:56.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:56.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:56.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:57.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:57.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:57.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:57.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:58.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:58.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:58.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:58.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:59.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:36:59.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:36:59.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:36:59.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:00.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:00.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:00.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:00.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:01.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:01.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:01.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:01.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:02.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:02.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:02.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:02.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:03.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:03.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:03.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:03.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:04.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:04.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:04.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:04.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:05.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:05.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:05.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:05.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:06.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:06.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:06.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:06.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:07.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:07.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:07.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:07.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:08.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:08.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:08.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:08.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:09.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:09.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:09.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:09.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:10.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:10.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:10.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:10.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:11.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:11.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:11.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:11.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:12.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:12.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:12.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:12.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:13.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:13.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:13.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:13.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:14.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:14.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:14.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:14.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:15.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:15.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:15.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:15.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:16.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:16.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:16.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:16.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:17.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:17.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:17.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:17.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:18.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:18.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:18.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:18.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:19.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:19.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:19.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:19.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:20.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:20.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:20.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:20.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:21.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:21.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:21.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:21.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:22.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:22.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:22.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:22.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:23.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:23.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:23.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:23.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:24.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:24.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:24.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:24.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:25.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:25.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:25.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:25.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:26.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:26.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:26.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:26.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:27.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:27.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:27.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:27.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:28.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:28.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:28.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:28.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:29.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:29.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:29.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:29.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:30.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:30.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:30.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:30.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:31.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:31.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:31.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:31.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:32.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:32.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:32.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:32.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:33.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:33.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:33.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:33.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:34.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:34.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:34.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:34.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:35.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:35.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:35.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:35.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:36.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:36.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:36.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:37.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:37.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:37.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:38.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:38.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:38.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:38.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:38.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:38.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:39.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:39.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:39.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:39.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:40.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:40.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:40.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:40.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:41.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:41.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:41.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:41.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:42.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:42.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:42.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:42.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:43.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:43.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:43.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:43.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:44.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:44.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:44.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:44.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:45.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:45.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:45.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:45.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:46.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:46.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:46.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:46.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:47.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:47.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:47.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:47.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:48.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:48.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:48.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:48.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:49.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:49.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:49.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:49.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:50.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:50.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:51.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:51.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:51.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:51.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:52.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:52.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:52.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:52.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:53.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:53.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:53.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:53.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:54.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:54.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:54.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:54.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:55.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:55.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:55.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:55.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:56.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:56.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:56.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:56.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:57.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:57.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:57.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:57.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:58.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:58.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:58.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:58.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:59.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:37:59.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:37:59.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:37:59.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:00.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:00.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:00.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:00.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:01.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:01.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:01.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:01.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:02.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:02.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:02.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:02.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:03.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:03.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:03.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:03.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:04.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:04.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:04.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:04.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:05.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:05.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:05.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:05.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:06.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:06.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:06.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:06.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:06.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:07.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:07.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:07.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:07.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:08.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:08.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:08.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:08.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:08.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:09.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:09.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:09.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:09.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:10.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:10.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:10.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:10.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:11.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:11.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:11.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:11.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:12.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:12.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:12.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:12.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:13.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:13.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:13.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:13.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:14.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:14.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:14.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:14.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:15.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:15.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:15.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:15.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:16.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:16.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:16.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:16.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:17.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:17.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:17.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:17.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:18.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:18.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:18.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:18.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:19.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:19.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:19.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:19.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:20.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:20.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:20.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:20.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:21.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:21.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:21.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:21.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:22.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:22.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:22.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:22.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:23.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:23.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:23.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:23.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:24.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:24.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:24.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:24.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:25.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:25.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:25.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:25.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:26.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:26.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:26.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:26.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:27.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:27.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:27.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:27.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:28.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:28.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:28.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:28.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:29.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:29.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:29.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:29.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:30.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:30.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:30.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:30.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:31.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:31.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:31.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:31.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:32.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:32.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:32.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:32.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:33.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:33.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:33.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:33.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:34.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:34.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:34.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:34.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:35.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:35.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:35.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:35.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:36.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:36.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:36.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:36.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:37.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:37.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:37.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:37.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:38.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:38.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:38.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:38.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:39.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:39.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:39.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:39.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:40.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:40.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:40.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:40.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:41.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:41.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:41.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:41.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:42.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:42.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:42.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:42.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:43.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:43.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:43.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:43.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:44.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:44.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:44.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:44.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:45.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:45.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:45.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:45.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:46.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:46.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:46.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:46.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:47.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:47.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:47.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:47.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:48.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:48.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:48.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:48.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:49.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:49.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:49.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:49.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:50.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:50.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:50.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:50.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:51.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:51.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:51.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:51.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:52.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:52.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:52.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:52.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:53.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:53.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:53.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:53.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:54.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:54.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:54.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:54.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:55.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:55.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:55.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:55.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:56.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:56.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:56.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:56.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:57.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:57.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:57.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:57.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:58.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:58.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:58.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:58.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:59.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:38:59.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:38:59.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:38:59.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:00.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:00.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:00.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:00.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:01.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:01.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:01.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:01.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:02.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:02.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:02.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:02.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:03.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:03.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:03.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:03.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:04.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:04.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:04.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:04.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:05.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:05.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:05.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:05.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:06.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:06.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:06.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:06.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:07.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:07.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:07.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:07.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:08.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:08.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:08.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:08.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:09.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:09.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:09.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:09.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:10.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:10.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:10.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:10.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:11.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:11.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:11.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:11.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:12.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:12.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:12.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:12.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:13.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:13.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:13.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:13.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:14.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:14.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:14.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:14.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:15.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:15.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:15.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:15.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:16.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:16.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:16.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:17.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:17.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:17.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:18.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:18.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:18.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:18.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:18.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:18.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:19.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:19.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:19.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:19.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:20.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:20.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:20.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:21.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:21.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:21.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:21.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:22.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:22.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:22.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:23.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:23.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:23.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:23.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:24.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:24.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:24.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:24.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:25.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:25.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:25.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:25.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:25.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:26.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:26.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:26.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:27.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:27.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:27.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:27.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:28.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:28.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:28.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:28.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:29.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:29.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:29.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:29.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:29.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:29.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:30.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:30.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:30.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:30.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:31.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:31.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:31.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:31.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:32.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:32.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:32.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:32.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:33.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:33.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:33.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:33.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:34.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:34.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:34.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:34.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:35.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:35.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:35.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:35.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:36.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:36.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:36.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:36.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:37.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:37.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:37.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:37.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:38.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:38.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:38.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:38.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:39.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:39.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:39.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:39.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:40.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:40.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:40.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:40.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:41.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:41.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:41.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:41.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:42.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:42.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:42.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:42.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:43.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:43.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:43.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:43.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:44.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:44.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:44.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:44.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:45.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:45.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:45.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:45.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:46.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:46.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:46.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:46.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:47.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:47.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:47.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:47.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:48.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:48.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:48.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:48.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:49.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:49.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:49.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:49.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:50.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:50.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:50.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:50.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:51.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:51.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:51.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:51.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:52.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:52.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:52.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:52.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:53.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:53.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:53.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:53.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:54.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:54.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:54.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:54.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:55.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:55.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:55.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:55.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:56.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:56.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:56.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:56.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:57.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:57.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:57.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:57.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:58.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:58.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:58.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:58.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:59.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:39:59.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:39:59.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:39:59.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:00.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:00.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:00.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:00.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:01.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:01.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:01.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:01.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:02.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:02.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:02.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:02.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:03.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:03.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:03.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:03.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:04.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:04.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:04.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:04.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:05.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:05.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:05.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:05.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:06.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:06.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:06.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:06.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:07.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:07.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:07.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:07.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:08.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:08.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:08.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:08.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:09.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:09.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:09.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:09.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:10.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:10.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:10.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:10.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:11.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:11.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:11.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:11.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:12.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:12.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:12.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:12.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:13.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:13.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:13.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:13.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:14.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:14.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:14.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:14.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:15.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:15.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:15.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:15.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:16.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:16.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:16.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:16.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:17.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:17.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:17.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:17.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:18.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:18.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:18.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:18.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:19.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:19.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:19.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:19.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:20.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:20.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:20.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:20.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:21.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:21.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:21.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:21.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:22.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:22.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:22.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:22.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:23.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:23.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:23.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:23.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:24.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:24.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:24.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:24.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:25.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:25.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:25.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:25.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:26.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:26.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:26.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:26.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:27.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:27.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:27.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:27.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:28.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:28.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:28.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:28.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:29.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:29.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:29.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:29.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:30.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:30.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:30.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:30.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:31.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:31.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:31.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:31.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:32.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:32.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:32.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:32.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:33.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:33.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:33.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:33.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:34.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:34.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:34.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:34.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:35.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:35.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:35.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:35.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:36.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:36.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:36.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:36.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:37.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:37.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:37.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:37.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:38.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:38.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:38.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:38.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:39.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:39.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:39.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:39.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:40.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:40.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:40.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:40.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:41.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:41.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:41.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:41.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:42.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:42.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:42.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:42.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:43.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:43.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:43.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:43.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:44.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:44.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:44.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:44.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:45.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:45.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:45.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:45.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:46.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:46.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:46.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:46.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:47.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:47.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:47.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:47.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:48.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:48.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:48.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:48.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:49.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:49.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:49.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:49.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:50.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:50.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:50.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:50.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:51.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:51.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:51.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:51.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:52.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:52.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:52.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:52.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:53.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:53.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:53.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:53.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:54.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:54.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:54.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:54.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:55.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:55.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:55.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:55.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:56.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:56.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:56.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:56.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:57.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:57.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:57.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:57.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:58.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:58.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:58.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:58.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:59.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:40:59.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:40:59.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:40:59.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:00.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:00.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:00.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:00.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:01.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:01.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:01.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:01.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:02.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:02.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:02.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:02.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:03.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:03.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:03.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:03.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:04.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:04.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:04.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:04.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:05.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:05.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:05.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:05.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:06.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:06.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:06.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:06.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:07.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:07.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:07.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:07.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:08.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:08.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:08.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:08.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:09.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:09.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:09.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:09.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:10.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:10.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:10.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:10.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:11.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:11.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:11.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:11.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:12.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:12.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:12.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:12.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:13.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:13.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:13.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:13.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:14.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:14.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:14.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:14.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:15.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:15.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:15.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:15.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:16.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:16.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:16.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:16.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:17.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:17.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:17.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:17.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:18.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:18.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:18.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:18.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:19.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:19.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:19.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:19.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:20.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:20.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:20.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:20.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:21.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:21.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:21.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:21.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:22.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:22.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:22.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:22.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:23.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:23.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:23.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:23.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:24.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:24.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:24.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:24.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:25.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:25.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:25.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:25.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:26.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:26.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:26.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:26.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:27.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:27.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:27.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:27.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:28.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:28.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:28.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:28.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:29.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:29.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:29.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:29.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:30.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:30.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:30.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:30.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:31.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:31.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:31.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:31.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:32.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:32.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:32.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:32.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:33.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:33.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:33.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:33.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:34.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:34.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:34.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:34.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:35.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:35.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:35.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:35.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:36.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:36.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:36.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:36.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:37.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:37.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:37.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:37.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:38.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:38.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:38.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:38.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:39.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:39.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:39.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:39.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:40.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:40.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:40.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:40.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:41.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:41.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:41.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:41.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:42.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:42.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:42.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:42.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:43.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:43.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:43.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:43.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:44.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:44.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:44.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:44.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:45.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:45.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:45.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:45.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:46.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:46.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:46.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:46.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:47.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:47.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:47.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:47.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:48.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:48.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:48.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:49.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:49.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:49.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:49.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:50.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:50.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:50.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:50.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:51.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:51.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:51.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:51.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:51.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:52.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:52.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:52.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:53.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:53.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:53.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:53.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:53.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:54.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:54.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:54.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:54.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:55.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:55.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:55.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:55.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:56.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:56.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:56.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:56.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:57.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:57.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:57.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:57.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:58.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:58.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:58.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:41:58.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:59.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:41:59.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:41:59.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:00.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:00.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:00.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:01.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:01.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:01.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:01.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:02.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:02.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:02.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:02.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:02.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:02.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:03.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:03.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:03.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:03.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:04.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:04.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:04.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:04.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:05.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:06.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:05.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:06.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:06.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:07.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:07.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:07.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:07.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:07.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:07.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:08.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:08.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:08.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:08.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:09.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:10.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:10.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:10.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:10.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:11.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:11.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:11.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:11.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:12.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:12.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:12.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:12.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:13.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:13.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:13.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:13.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:14.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:14.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:14.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:14.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:15.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:15.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:15.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:15.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:16.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:16.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:16.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:16.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:17.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:17.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:17.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:17.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:18.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:18.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:18.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:18.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:19.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:19.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:19.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:19.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:20.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:20.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:20.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:20.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:20.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:21.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:21.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:21.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:22.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:22.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:22.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:22.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:22.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:23.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:23.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:23.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:24.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:24.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:24.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:24.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:25.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:25.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:25.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:25.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:26.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:26.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:26.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:26.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:26.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:27.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:27.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:27.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:27.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:28.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:28.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:28.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:28.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:28.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:29.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:29.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:29.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:29.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:30.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:30.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:30.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:31.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:31.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:31.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:32.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:32.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:32.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:32.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:32.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:32.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:33.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:33.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:34.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:34.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:34.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:34.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:35.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:35.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:35.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:35.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:36.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:36.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:36.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:36.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:37.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:37.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:37.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:37.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:37.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:38.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:38.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:38.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:39.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:39.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:39.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:39.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:40.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:40.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:40.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:40.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:41.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:41.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:41.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:41.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:42.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:42.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:42.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:42.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:43.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:43.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:43.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:43.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:43.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:44.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:44.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:44.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:44.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:44.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:45.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:45.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:45.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:45.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:46.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:46.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:46.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:47.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:47.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:47.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:47.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:48.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:48.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:48.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:48.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:49.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:49.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:49.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:49.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:49.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:50.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:50.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:50.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:50.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:51.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:51.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:51.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:51.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:52.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:52.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:52.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:52.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:53.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:53.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:53.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:53.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:54.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:54.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:54.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:54.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:55.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:55.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:55.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:55.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:56.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:56.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:56.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:56.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:57.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:57.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:57.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:57.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:58.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:58.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:58.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:58.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:59.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:42:59.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:42:59.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:42:59.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:00.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:00.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:00.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:00.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:01.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:01.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:01.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:01.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:02.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:02.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:02.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:02.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:03.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:03.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:03.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:03.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:04.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:04.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:04.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:04.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:05.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:05.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:05.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:05.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:06.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:06.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:06.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:06.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:07.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:07.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:07.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:07.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:08.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:08.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:08.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:08.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:09.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:09.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:09.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:09.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:10.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:10.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:10.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:10.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:11.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:11.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:11.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:11.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:12.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:12.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:12.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:12.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:13.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:13.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:14.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:14.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:14.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:14.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:15.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:15.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:15.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:15.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:16.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:16.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:16.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:16.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:17.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:17.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:17.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:17.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:18.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:18.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:18.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:18.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:18.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:19.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:19.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:19.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:19.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:20.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:20.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:20.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:21.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:21.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:21.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:21.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:22.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:22.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:22.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:22.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:23.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:23.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:23.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:23.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:24.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:24.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:24.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:24.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:24.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:25.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:25.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:25.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:26.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:26.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:26.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:26.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:26.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:27.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:27.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:27.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:27.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:28.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:28.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:28.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:29.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:29.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:29.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:29.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:30.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:30.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:30.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:30.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:31.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:31.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:31.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:31.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:32.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:32.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:32.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:32.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:33.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:33.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:33.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:33.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:34.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:34.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:34.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:34.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:35.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:35.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:35.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:35.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:36.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:36.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:36.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:36.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:37.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:37.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:37.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:37.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:38.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:38.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:38.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:38.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:39.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:39.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:39.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:39.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:40.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:40.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:40.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:40.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:41.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:41.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:41.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:41.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:42.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:42.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:42.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:42.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:43.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:43.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:43.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:43.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:44.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:44.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:44.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:44.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:45.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:45.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:45.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:45.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:46.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:46.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:46.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:46.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:47.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:47.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:47.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:47.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:48.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:48.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:48.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:48.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:49.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:49.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:49.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:49.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:50.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:50.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:50.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:50.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:51.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:51.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:51.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:51.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:52.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:52.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:52.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:52.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:53.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:53.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:53.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:53.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:54.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:54.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:54.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:54.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:55.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:55.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:55.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:55.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:56.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:56.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:56.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:56.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:57.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:57.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:57.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:57.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:58.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:58.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:58.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:58.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:59.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:43:59.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:43:59.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:43:59.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:00.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:00.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:00.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:00.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:01.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:01.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:01.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:01.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:02.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:02.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:02.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:02.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:03.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:03.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:03.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:03.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:04.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:04.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:04.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:04.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:05.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:05.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:05.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:05.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:06.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:06.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:06.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:06.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:07.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:07.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:07.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:07.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:08.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:08.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:08.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:08.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:09.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:09.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:09.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:09.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:10.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:10.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:10.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:10.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:11.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:11.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:11.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:11.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:12.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:12.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:12.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:12.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:13.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:13.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:13.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:13.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:14.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:14.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:14.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:14.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:15.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:15.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:15.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:15.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:16.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:16.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:16.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:16.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:17.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:17.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:17.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:17.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:18.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:18.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:18.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:18.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:19.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:19.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:19.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:19.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:20.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:20.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:20.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:20.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:21.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:21.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:21.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:21.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:22.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:22.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:22.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:22.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:23.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:23.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:23.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:23.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:24.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:24.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:24.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:24.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:25.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:25.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:25.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:25.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:26.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:26.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:26.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:26.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:27.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:27.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:27.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:27.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:28.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:28.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:28.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:28.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:29.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:29.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:29.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:29.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:30.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:30.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:30.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:30.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:31.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:31.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:31.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:31.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:32.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:32.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:32.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:32.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:33.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:33.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:33.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:33.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:34.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:34.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:34.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:34.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:35.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:35.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:35.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:35.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:36.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:36.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:36.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:36.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:37.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:37.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:37.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:37.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:38.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:38.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:38.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:38.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:39.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:39.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:39.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:39.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:40.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:40.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:40.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:40.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:41.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:41.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:41.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:41.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:42.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:42.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:42.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:42.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:43.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:43.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:43.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:43.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:44.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:44.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:44.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:44.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:45.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:45.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:45.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:45.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:46.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:46.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:46.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:46.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:47.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:47.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:47.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:47.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:48.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:48.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:48.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:48.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:49.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:49.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:49.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:49.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:50.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:50.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:50.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:50.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:51.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:51.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:51.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:51.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:52.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:52.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:52.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:52.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:53.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:53.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:53.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:53.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:53.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:54.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:54.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:54.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:55.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:55.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:55.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:55.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:55.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:56.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:56.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:56.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:56.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:57.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:57.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:57.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:58.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:58.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:58.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:58.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:59.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:44:59.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:44:59.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:44:59.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:00.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:00.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:00.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:00.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:01.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:01.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:01.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:01.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:02.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:02.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:02.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:02.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:03.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:03.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:03.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:03.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:04.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:04.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:04.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:04.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:05.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:05.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:05.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:05.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:06.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:06.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:06.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:06.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:07.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:07.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:07.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:07.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:08.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:08.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:08.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:08.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:09.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:09.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:09.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:09.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:10.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:10.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:10.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:10.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:11.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:11.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:11.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:11.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:12.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:12.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:12.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:12.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:13.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:13.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:13.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:13.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:14.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:14.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:14.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:14.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:14.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:15.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:15.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:15.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:15.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:15.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:16.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:16.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:16.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:16.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:17.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:17.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:17.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:17.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:18.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:18.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:18.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:19.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:19.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:19.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:19.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:20.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:20.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:20.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:21.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:21.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:21.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:21.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:22.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:22.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:22.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:22.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:23.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:23.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:23.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:23.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:24.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:24.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:24.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:24.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:25.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:25.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:25.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:25.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:26.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:26.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:26.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:26.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:27.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:27.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:27.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:27.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:28.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:28.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:28.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:28.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:28.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:29.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:29.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:29.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:30.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:30.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:30.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:30.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:30.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:31.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:31.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:31.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:31.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:31.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:32.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:32.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:32.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:32.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 30 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:33.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:33.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:33.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:33.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:34.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:34.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:34.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:34.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:35.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:35.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:35.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:35.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:36.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:36.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:36.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:36.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:37.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:37.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:37.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:37.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:38.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:38.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:38.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:38.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:39.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:39.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:39.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:39.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:40.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:40.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:40.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:40.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:41.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:41.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:41.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:41.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:42.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:42.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:42.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:42.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:43.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:43.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:43.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:43.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:44.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:44.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:44.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:44.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:45.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:45.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:45.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:45.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:46.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:46.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:46.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:47.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:47.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:47.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:48.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:48.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:48.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:48.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:48.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:49.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:49.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:49.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:49.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:50.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:50.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:50.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:50.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:51.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:51.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:51.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:51.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:52.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:52.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:52.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:52.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:52.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:53.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:53.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:53.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:53.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:54.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:54.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:54.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:54.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:55.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:55.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:55.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:55.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:56.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:56.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:56.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:56.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:57.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:57.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:57.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:58.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:58.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:58.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:58.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:45:59.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:45:59.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:45:59.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:00.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:00.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:00.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:00.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:01.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:01.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:01.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:01.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:02.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:02.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:02.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:02.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:03.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:03.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:03.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:03.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:04.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:04.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:04.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:04.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:05.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:05.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:05.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:05.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:06.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:06.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:06.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:06.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:07.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:07.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:07.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:07.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:08.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:08.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:08.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:08.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:09.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:09.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:09.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:09.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:10.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:10.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:10.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:10.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:11.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:11.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:11.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:11.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:12.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:12.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:12.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:12.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:13.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:13.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:13.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:13.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:14.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:14.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:14.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:14.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:15.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:15.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:15.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:15.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:16.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:16.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:16.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:16.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:17.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:17.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:17.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:17.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:18.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:18.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:18.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:18.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:19.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:19.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:19.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:19.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:20.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:20.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:20.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:20.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:21.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:21.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:21.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:21.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:22.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:22.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:22.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:22.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:23.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:23.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:23.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:23.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:24.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:24.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:24.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:24.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:25.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:25.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:25.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:25.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:26.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:26.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:26.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:26.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:27.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:27.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:27.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:27.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:28.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:28.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:28.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:28.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:29.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:29.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:29.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:29.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:30.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:30.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:30.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:30.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:31.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:31.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:31.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:31.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:32.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:32.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:32.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:32.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:33.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:33.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:33.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:33.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:34.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:34.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:34.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:34.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:35.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:35.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:35.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:35.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:36.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:36.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:36.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:36.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:37.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:37.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:37.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:37.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:38.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:38.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:38.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:38.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:39.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:39.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:39.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:39.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:40.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:40.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:40.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:40.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:41.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:41.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:41.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:41.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:42.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:42.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:42.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:42.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:43.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:43.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:43.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:43.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:44.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:44.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:44.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:44.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:45.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:45.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:45.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:45.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:46.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:46.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:46.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:46.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:47.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:47.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:47.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:47.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:48.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:48.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:48.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:48.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:49.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:49.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:49.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:49.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:50.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:50.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:50.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:50.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:51.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:51.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:51.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:51.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:52.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:52.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:52.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:52.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:53.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:53.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:53.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:53.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:54.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:54.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:54.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:54.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:55.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:55.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:55.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:55.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:56.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:56.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:56.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:56.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:57.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:57.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:57.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:57.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:58.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:58.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:58.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:58.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:59.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:46:59.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:46:59.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:46:59.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:00.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:00.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:00.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:00.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:01.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:01.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:01.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:01.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:02.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:02.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:02.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:02.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:03.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:03.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:03.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:03.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:04.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:04.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:04.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:04.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:05.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:05.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:05.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:05.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:06.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:06.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:06.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:06.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:07.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:07.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:07.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:07.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:08.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:08.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:08.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:08.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:09.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:09.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:09.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:09.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:10.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:10.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:10.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:10.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:11.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:11.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:11.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:11.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:12.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:12.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:12.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:12.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:13.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:13.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:13.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:13.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:14.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:14.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:14.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:14.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:15.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:15.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:15.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:15.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:16.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:16.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:16.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:16.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:17.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:17.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:17.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:17.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:18.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:18.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:18.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:18.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:19.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:19.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:19.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:19.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:20.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:20.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:20.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:20.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:21.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:21.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:21.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:21.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:22.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:22.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:22.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:22.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:23.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:23.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:23.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:23.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:24.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:24.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:24.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:24.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:25.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:25.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:25.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:25.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:26.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:26.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:26.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:26.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:27.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:27.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:27.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:27.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:28.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:28.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:28.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:28.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:29.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:29.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:29.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:29.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:30.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:30.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:30.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:30.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:31.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:31.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:31.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:31.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:32.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:32.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:32.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:32.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:33.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:33.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:33.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:33.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:34.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:34.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:34.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:34.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:35.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:35.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:35.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:35.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:36.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:36.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:36.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:36.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:37.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:37.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:37.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:37.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:38.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:38.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:38.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:38.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:39.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:39.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:39.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:39.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:40.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:40.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:40.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:40.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:41.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:41.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:41.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:41.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:42.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:42.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:42.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:42.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:43.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:43.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:43.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:43.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:44.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:44.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:44.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:44.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:45.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:45.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:45.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:45.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:46.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:46.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:46.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:46.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:47.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:47.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:47.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:47.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:48.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:48.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:48.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:48.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:49.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:49.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:49.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:49.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:50.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:50.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:50.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:50.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:51.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:51.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:51.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:51.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:52.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:52.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:52.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:52.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:53.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:53.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:53.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:53.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:54.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:54.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:54.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:54.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:55.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:55.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:55.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:55.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:56.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:56.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:56.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:56.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:57.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:57.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:57.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:57.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:58.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:58.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:58.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:58.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:59.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:47:59.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:47:59.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:47:59.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:00.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:00.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:00.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:00.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:01.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:01.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:01.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:01.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:02.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:02.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:02.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:02.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:03.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:03.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:03.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:03.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:04.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:04.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:04.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:04.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:05.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:05.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:05.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:05.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:06.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:06.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:06.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:06.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:07.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:07.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:07.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:07.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:08.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:08.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:08.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:08.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:09.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:09.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:09.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:09.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:10.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:10.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:10.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:10.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:11.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:11.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:11.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:11.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:12.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:12.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:12.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:12.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:13.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:13.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:13.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:13.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:14.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:14.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:14.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:14.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:15.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:15.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:15.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:15.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:16.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:16.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:16.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:16.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:17.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:17.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:17.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:17.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:18.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:18.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:18.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:18.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:19.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:19.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:19.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:19.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:20.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:20.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:20.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:20.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:21.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:21.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:21.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:21.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:22.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:22.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:22.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:22.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:23.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:23.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:23.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:23.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:24.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:24.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:24.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:24.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:25.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:25.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:25.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:25.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:26.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:26.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:26.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:26.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:27.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:27.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:27.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:27.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:28.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:28.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:28.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:28.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:29.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:29.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:29.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:29.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:30.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:30.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:30.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:30.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:31.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:31.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:31.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:31.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:32.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:32.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:32.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:32.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:33.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:33.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:33.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:33.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:34.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:34.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:34.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:34.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:35.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:35.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:35.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:35.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:36.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:36.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:36.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:36.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:37.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:37.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:37.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:37.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:38.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:38.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:38.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:38.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:39.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:39.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:39.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:39.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:40.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:40.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:40.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:40.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:41.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:41.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:41.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:41.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:42.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:42.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:42.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:42.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:43.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:43.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:43.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:43.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:44.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:44.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:44.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:44.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:45.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:45.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:45.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:45.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:46.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:46.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:46.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:46.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:47.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:47.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:47.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:47.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:48.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:48.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:48.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:48.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:49.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:49.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:49.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:49.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:50.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:50.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:50.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:50.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:51.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:51.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:51.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:51.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:52.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:52.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:52.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:52.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:53.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:53.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:53.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:53.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:54.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:54.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:54.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:54.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:55.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:55.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:55.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:55.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:56.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:56.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:56.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:56.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:57.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:57.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:57.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:57.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:58.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:58.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:58.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:58.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:59.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:48:59.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:48:59.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:48:59.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:00.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:00.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:00.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:00.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:01.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:01.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:01.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:01.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:02.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:02.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:02.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:02.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:03.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:03.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:03.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:03.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:04.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:04.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:04.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:04.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:05.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:05.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:05.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:05.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:06.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:06.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:06.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:06.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:07.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:07.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:07.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:07.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:08.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:08.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:08.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:08.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:09.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:09.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:09.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:09.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:10.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:10.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:10.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:10.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:11.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:11.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:11.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:11.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:12.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:12.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:12.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:12.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:13.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:13.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:13.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:13.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:14.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:14.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:14.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:14.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:15.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:15.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:15.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:15.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:16.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:16.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:16.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:16.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:17.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:17.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:17.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:17.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:18.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:18.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:18.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:18.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:19.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:19.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:19.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:19.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:20.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:20.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:20.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:20.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:21.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:21.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:21.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:21.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:22.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:22.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:22.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:22.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:23.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:23.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:23.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:23.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:24.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:24.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:24.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:24.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:25.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:25.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:25.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:25.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:26.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:26.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:26.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:26.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:27.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:27.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:27.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:27.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:28.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:28.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:28.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:28.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:29.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:29.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:29.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:29.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:30.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:30.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:30.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:30.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:31.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:31.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:31.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:31.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:32.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:32.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:32.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:32.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:33.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:33.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:33.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:33.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:34.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:34.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:34.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:34.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:35.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:35.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:35.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:35.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:36.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:36.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:36.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:36.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:37.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:37.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:37.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:37.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:38.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:38.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:38.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:38.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:39.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:39.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:39.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:39.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:40.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:40.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:40.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:40.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:41.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:41.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:41.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:41.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:42.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:42.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:42.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:42.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:43.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:43.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:43.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:43.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:44.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:44.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:44.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:44.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:45.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:45.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:45.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:45.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:46.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:46.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:46.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:46.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:47.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:47.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:47.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:47.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:48.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:48.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:48.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:48.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:49.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:49.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:49.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:49.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:50.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:50.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:50.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:50.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:51.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:51.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:51.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:51.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:52.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:52.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:52.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:52.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:53.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:53.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:53.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:53.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:54.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:54.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:54.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:54.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:55.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:55.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:55.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:55.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:56.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:56.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:56.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:56.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:57.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:57.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:57.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:57.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:58.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:58.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:58.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:58.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:59.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:49:59.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:49:59.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:49:59.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:00.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:00.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:00.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:00.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:01.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:01.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:01.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:01.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:02.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:02.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:02.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:02.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:03.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:03.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:03.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:03.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:04.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:04.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:04.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:04.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:05.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:05.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:05.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:05.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:06.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:06.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:06.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:06.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:07.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:07.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:07.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:07.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:08.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:08.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:08.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:08.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:09.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:09.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:09.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:09.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:10.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:10.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:10.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:10.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:11.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:11.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:11.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:11.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:12.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:12.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:12.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:12.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:13.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:13.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:13.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:13.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:14.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:14.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:14.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:14.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:15.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:15.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:15.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:15.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:16.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:16.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:16.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:16.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:17.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:17.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:17.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:17.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:18.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:18.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:18.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:18.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:19.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:19.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:19.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:19.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:20.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:20.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:20.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:20.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:21.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:21.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:21.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:21.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:22.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:22.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:22.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:22.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:23.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:23.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:23.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:23.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:24.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:24.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:24.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:24.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:25.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:25.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:25.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:25.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:26.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:26.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:26.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:26.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:27.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:27.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:27.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:27.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:28.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:28.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:28.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:28.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:29.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:29.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:29.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:29.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:30.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:30.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:30.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:30.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:31.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:31.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:31.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:31.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:32.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:32.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:32.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:32.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:33.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:33.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:33.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:33.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:34.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:34.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:34.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:34.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:35.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:35.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:35.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:35.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:36.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:36.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:36.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:36.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:37.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:37.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:37.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:37.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:38.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:38.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:38.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:38.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:39.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:39.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:39.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:39.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:40.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:40.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:40.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:40.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:41.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:41.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:41.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:41.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:42.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:42.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:42.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:42.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:43.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:43.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:43.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:43.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:44.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:44.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:44.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:44.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:45.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:45.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:45.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:45.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:46.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:46.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:46.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:46.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:47.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:47.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:47.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:47.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:48.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:48.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:48.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:48.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:49.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:49.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:49.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:49.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:50.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:50.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:50.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:50.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:51.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:51.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:51.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:51.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:52.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:52.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:52.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:53.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:53.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:53.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:53.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:54.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:54.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:54.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:54.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:54.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:55.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:55.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:55.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:56.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:56.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:56.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:56.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:57.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:57.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:57.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:57.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:57.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:58.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:58.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:58.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:50:59.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:59.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:50:59.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:50:59.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:00.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:00.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:00.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:01.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:01.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:01.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:01.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:02.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:02.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:02.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:02.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:03.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:03.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:03.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:03.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:03.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:04.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:04.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:04.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:04.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:05.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:05.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:05.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:06.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:06.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:06.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:06.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:07.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:07.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:07.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:07.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:07.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:08.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:08.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:08.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:09.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:09.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:09.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:09.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:10.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:10.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:10.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:10.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:11.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:11.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:11.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:11.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:12.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:12.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:12.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:12.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:13.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:13.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:13.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:13.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:14.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:14.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:14.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:14.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:15.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:15.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:15.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:15.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:16.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:16.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:16.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:16.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:17.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:17.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:17.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:17.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:18.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:18.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:18.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:18.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:19.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:19.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:19.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:19.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:20.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:20.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:20.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:20.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:21.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:21.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:21.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:21.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:22.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:22.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:22.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:22.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:23.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:23.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:23.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:23.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:24.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:24.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:24.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:24.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:25.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:25.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:25.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:25.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:26.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:26.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:26.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:26.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:26.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:27.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:27.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:27.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:27.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:28.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:28.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:28.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:29.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:29.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:29.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:29.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:29.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:30.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:30.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:30.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:30.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:31.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:31.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:31.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:32.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:32.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:32.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:32.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:33.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:33.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:33.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:33.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:34.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:34.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:34.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:34.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:35.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:35.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:35.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:35.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:36.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:36.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:36.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:36.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:37.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:37.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:37.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:37.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:38.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:38.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:38.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:38.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:39.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:39.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:39.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:39.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:40.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:40.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:40.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:40.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:41.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:41.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:41.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:41.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:42.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:42.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:42.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:42.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:43.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:43.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:43.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:43.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:44.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:44.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:44.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:44.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:45.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:45.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:45.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:45.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:46.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:46.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:46.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:46.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:47.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:47.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:47.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:47.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:48.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:48.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:48.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:48.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:49.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:49.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:49.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:49.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:50.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:50.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:50.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:50.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:51.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:51.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:51.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:51.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:52.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:52.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:52.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:52.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:53.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:53.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:53.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:53.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:54.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:54.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:54.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:54.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:55.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:55.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:55.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:55.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:56.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:56.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:56.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:56.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:57.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:57.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:57.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:57.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:58.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:58.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:58.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:58.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:59.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:51:59.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:51:59.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:51:59.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:00.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:00.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:00.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:00.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:01.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:01.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:01.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:01.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:02.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:02.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:02.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:02.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:03.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:03.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:03.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:03.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:04.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:04.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:04.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:04.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:05.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:05.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:05.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:05.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:06.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:06.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:06.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:06.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:07.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:07.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:07.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:07.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:08.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:08.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:08.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:08.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:09.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:09.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:09.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:09.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:10.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:10.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:10.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:10.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:11.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:11.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:11.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:11.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:12.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:12.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:12.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:12.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:13.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:13.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:13.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:13.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:14.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:14.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:14.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:14.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:15.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:15.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:15.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:15.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:16.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:16.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:16.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:16.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:17.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:17.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:17.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:17.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:18.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:18.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:18.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:18.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:19.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:19.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:19.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:19.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:20.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:20.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:20.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:20.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:21.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:21.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:21.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:21.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:22.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:22.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:22.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:22.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:23.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:23.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:23.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:23.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:24.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:24.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:24.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:24.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:25.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:25.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:25.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:25.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:26.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:26.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:26.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:26.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:27.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:27.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:27.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:27.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:28.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:28.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:28.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:28.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:29.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:29.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:29.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:29.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:30.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:30.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:30.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:30.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:31.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:31.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:31.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:31.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:32.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:32.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:32.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:32.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:33.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:33.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:33.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:33.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:34.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:34.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:34.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:34.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:35.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:35.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:35.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:35.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:36.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:36.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:36.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:36.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:37.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:37.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:37.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:37.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:38.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:38.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:38.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:38.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:39.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:39.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:39.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:39.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:40.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:40.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:40.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:40.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:41.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:41.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:41.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:41.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:42.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:42.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:42.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:42.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:43.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:43.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:43.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:43.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:44.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:44.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:44.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:44.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:45.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:45.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:45.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:45.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:46.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:46.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:46.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:46.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:47.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:47.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:47.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:47.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:48.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:48.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:48.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:48.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:49.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:49.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:49.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:49.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:50.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:50.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:50.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:50.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:51.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:51.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:51.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:51.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:52.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:52.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:52.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:52.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:53.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:53.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:53.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:53.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:54.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:54.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:54.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:54.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:55.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:55.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:55.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:55.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:56.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:56.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:56.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:56.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:57.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:57.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:57.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:57.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:58.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:58.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:58.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:58.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:59.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:52:59.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:52:59.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:52:59.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:00.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:00.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:00.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:00.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:01.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:01.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:01.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:01.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:02.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:02.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:02.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:02.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:03.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:03.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:03.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:03.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:04.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:04.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:04.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:04.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:05.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:05.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:05.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:05.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:06.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:06.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:06.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:06.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:07.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:07.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:07.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:07.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:08.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:08.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:08.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:08.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:09.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:09.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:09.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:09.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:10.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:10.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:10.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:10.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:11.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:11.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:11.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:11.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:12.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:12.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:12.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:12.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:13.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:13.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:13.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:13.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:14.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:14.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:14.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:14.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:15.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:15.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:15.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:15.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:16.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:16.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:16.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:16.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:17.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:17.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:17.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:17.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:18.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:18.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:18.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:18.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:19.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:19.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:19.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:19.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:20.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:20.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:20.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:20.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:21.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:21.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:21.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:21.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:22.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:22.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:22.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:22.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:23.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:23.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:23.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:23.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:24.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:24.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:24.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:24.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:25.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:25.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:25.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:25.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:26.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:26.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:26.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:26.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:27.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:27.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:27.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:27.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:28.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:28.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:28.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:28.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:29.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:29.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:29.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:29.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:30.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:30.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:30.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:30.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:31.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:31.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:31.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:31.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:32.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:32.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:32.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:32.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:33.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:33.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:33.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:33.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:34.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:34.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:34.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:34.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:35.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:35.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:35.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:35.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:36.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:36.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:36.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:36.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:37.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:37.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:37.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:37.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:38.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:38.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:38.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:38.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:39.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:39.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:39.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:39.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:40.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:40.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:40.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:40.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:41.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:41.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:41.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:41.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:42.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:42.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:42.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:42.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:43.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:43.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:43.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:43.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:44.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:44.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:44.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:44.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:45.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:45.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:45.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:45.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:46.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:46.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:46.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:46.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:47.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:47.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:47.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:47.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:48.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:48.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:48.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:48.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:49.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:49.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:49.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:49.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:50.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:50.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:50.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:50.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:51.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:51.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:51.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:51.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:52.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:52.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:52.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:52.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:53.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:53.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:53.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:53.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:54.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:54.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:54.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:54.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:55.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:55.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:55.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:55.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:56.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:56.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:56.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:56.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:57.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:57.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:57.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:57.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:58.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:58.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:58.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:58.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:59.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:53:59.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:53:59.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:53:59.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:00.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:00.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:00.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:00.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:01.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:01.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:01.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:01.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:02.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:02.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:02.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:02.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:03.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:03.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:03.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:03.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:04.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:04.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:04.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:05.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:05.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:05.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:05.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:05.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:06.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:06.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:06.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:06.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:07.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:07.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:07.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:08.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:08.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:08.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:08.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:09.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:09.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:09.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:10.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:10.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:10.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:10.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:11.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:11.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:11.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:11.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:12.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:12.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:12.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:12.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:13.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:13.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:13.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:13.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:13.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:14.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:14.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:14.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:15.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:15.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:15.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:15.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:16.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:16.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:16.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:16.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:17.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:17.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:17.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:17.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:17.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:18.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:18.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:18.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:19.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:19.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:19.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:19.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:20.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:20.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:20.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:20.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:21.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:21.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:21.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:21.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:22.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:22.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:22.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:22.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:23.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:23.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:23.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:23.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:24.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:24.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:24.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:24.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:25.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:25.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:25.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:25.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:26.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:26.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:26.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:26.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:26.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:27.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:27.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:27.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:27.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:28.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:28.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:28.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:28.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:29.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:29.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:29.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:29.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:30.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:30.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:30.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:31.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:31.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:31.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:31.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:31.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:32.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:32.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:32.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:32.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:33.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:33.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:33.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:34.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:34.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:34.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:34.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:35.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:35.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:35.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:35.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:36.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:36.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:36.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:36.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:37.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:37.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:37.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:37.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:37.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:38.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:38.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:38.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:39.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:39.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:39.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:39.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:40.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:40.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:40.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:40.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:41.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:41.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:41.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:41.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:42.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:42.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:42.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:42.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:43.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:43.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:43.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:43.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:44.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:44.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:44.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:44.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:45.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:45.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:45.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:45.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:46.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:46.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:46.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:46.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:47.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:47.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:47.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:47.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:48.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:48.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:48.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:48.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:49.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:49.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:49.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:49.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:50.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:50.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:50.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:50.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:51.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:51.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:51.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:51.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:52.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:52.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:52.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:52.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:53.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:53.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:53.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:53.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:54.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:54.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:54.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:54.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:55.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:55.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:55.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:55.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:56.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:56.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:56.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:56.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:57.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:57.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:57.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:57.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:58.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:58.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:58.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:58.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:59.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:54:59.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:54:59.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:54:59.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:00.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:00.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:00.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:00.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:00.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:01.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:01.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:01.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:02.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:02.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:02.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:02.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:03.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:03.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:03.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:03.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:04.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:04.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:04.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:04.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:05.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:05.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:05.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:05.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:06.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:06.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:06.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:06.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:06.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:07.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:07.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:07.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:07.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:08.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:08.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:08.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:09.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:09.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:09.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:09.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:10.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:10.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:10.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:10.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:11.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:11.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:11.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:11.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:12.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:12.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:12.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:12.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:13.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:13.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:13.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:13.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:14.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:14.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:14.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:14.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:15.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:15.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:15.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:15.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:16.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:16.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:16.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:16.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:17.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:17.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:17.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:17.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:18.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:18.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:18.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:18.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:18.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:19.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:19.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:19.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:19.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:20.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:20.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:20.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:20.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:21.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:21.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:21.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:21.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:21.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:22.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:22.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:22.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:22.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:23.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:23.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:23.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:23.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:24.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:24.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:24.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:24.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:25.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:25.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:25.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:25.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:26.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:26.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:26.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:26.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:27.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:27.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:27.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:27.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:28.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:28.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:28.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:28.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:29.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:29.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:29.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:29.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:30.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:30.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:30.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:30.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:31.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:31.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:31.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:31.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:32.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:32.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:32.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:32.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:33.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:33.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:33.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:33.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:34.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:34.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:34.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:34.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:35.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:35.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:35.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:35.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:36.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:36.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:36.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:37.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:37.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:37.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:38.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:38.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:38.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:38.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:39.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:39.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:39.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:39.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:40.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:40.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:40.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:40.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:41.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:41.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:41.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:41.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:41.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:42.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:42.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:42.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:42.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:43.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:43.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:43.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:43.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:44.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:44.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:44.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:44.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:45.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:45.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:45.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:45.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:46.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:46.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:46.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:46.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:47.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:47.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:47.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:47.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:48.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:48.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:48.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:48.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:49.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:49.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:49.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:49.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:50.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:50.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:50.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:50.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:51.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:51.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:51.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:51.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:52.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:52.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:52.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:52.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:53.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:53.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:53.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:53.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:53.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:54.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:54.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:54.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:55.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:55.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:55.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:55.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:55.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:56.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:56.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:56.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:57.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:57.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:57.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:58.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:58.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:58.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:58.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:59.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:55:59.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:55:59.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:55:59.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:00.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:00.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:00.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:00.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:01.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:01.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:01.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:01.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:02.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:02.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:02.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:02.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:03.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:03.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:03.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:03.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:04.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:04.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:04.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:04.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:05.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:05.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:05.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:05.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:06.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:06.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:06.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:06.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:07.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:07.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:07.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:07.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:08.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:08.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:08.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:08.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:09.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:09.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:09.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:09.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:10.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:10.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:10.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:10.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:11.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:11.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:11.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:11.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:12.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:12.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:12.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:12.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:13.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:13.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:13.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:13.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:14.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:14.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:14.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:14.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:15.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:15.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:15.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:15.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:16.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:16.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:16.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:16.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:17.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:17.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:17.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:17.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:18.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:18.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:18.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:18.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:19.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:19.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:19.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:19.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:20.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:20.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:20.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:20.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:21.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:21.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:21.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:21.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:22.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:22.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:22.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:22.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:23.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:23.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:23.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:23.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:24.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:24.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:24.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:24.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:25.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:25.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:25.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:25.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:26.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:26.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:26.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:26.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:27.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:27.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:27.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:27.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:28.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:28.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:28.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:28.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:29.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:29.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:29.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:29.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:30.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:30.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:30.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:30.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:31.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:31.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:31.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:31.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:32.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:32.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:32.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:32.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:33.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:33.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:33.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:33.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:34.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:34.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:34.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:34.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:35.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:35.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:35.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:35.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:36.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:36.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:36.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:36.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:37.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:37.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:37.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:37.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:38.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:38.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:38.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:38.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:39.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:39.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:39.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:39.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:40.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:40.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:40.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:40.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:41.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:41.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:41.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:41.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:42.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:42.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:42.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:42.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:43.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:43.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:43.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:43.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:44.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:44.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:44.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:44.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:45.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:45.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:45.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:45.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:46.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:46.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:46.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:46.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:47.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:47.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:47.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:47.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:48.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:48.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:48.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:48.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:49.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:49.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:49.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:49.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:50.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:50.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:50.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:50.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:51.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:51.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:51.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:51.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:52.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:52.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:52.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:52.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:53.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:53.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:53.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:53.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:54.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:54.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:54.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:54.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:55.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:55.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:55.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:55.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:56.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:56.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:56.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:56.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:57.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:57.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:57.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:57.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:58.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:58.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:58.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:58.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:59.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:56:59.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:56:59.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:56:59.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:00.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:00.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:00.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:00.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:01.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:01.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:01.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:01.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:02.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:02.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:02.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:02.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:03.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:03.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:03.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:03.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:04.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:04.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:04.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:04.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:05.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:05.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:05.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:05.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:06.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:06.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:06.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:06.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:07.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:07.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:07.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:07.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:08.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:08.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:08.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:08.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:09.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:09.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:09.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:09.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:10.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:10.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:10.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:10.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:11.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:11.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:11.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:11.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:12.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:12.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:12.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:12.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:13.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:13.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:13.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:13.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:14.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:14.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:14.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:14.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:15.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:15.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:15.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:15.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:16.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:16.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:16.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:16.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:17.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:17.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:17.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:17.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:18.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:18.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:18.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:18.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:19.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:19.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:19.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:20.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:20.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:20.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:20.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:21.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:21.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:21.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:21.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:22.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:22.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:22.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:22.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:22.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:23.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:23.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:23.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:24.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:24.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:24.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:24.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:25.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:25.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:25.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:26.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:26.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:26.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:26.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:26.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:27.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:27.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:27.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:27.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:28.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:28.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:28.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:28.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:28.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:29.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:29.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:29.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:30.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:30.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:30.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:30.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:31.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:31.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:31.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:31.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:32.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:32.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:32.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:33.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:33.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:33.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:33.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:33.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:34.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:34.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:34.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:34.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:34.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:35.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:35.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:35.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:35.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:36.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:36.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:36.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:36.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:37.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:37.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:37.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:37.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:38.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:38.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:38.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:38.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:39.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:39.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:39.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:39.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:40.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:40.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:40.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:40.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:41.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:41.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:41.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:42.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:42.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:42.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:42.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:43.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:43.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:43.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:43.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:43.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:44.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:44.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:44.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:44.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:45.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:45.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:45.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:45.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:46.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:46.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:46.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:46.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:47.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:47.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:47.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:47.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:48.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:48.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:48.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:48.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:49.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:49.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:49.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:49.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:50.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:50.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:50.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:51.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:51.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:51.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:51.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:52.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:52.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:52.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:52.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:53.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:53.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:53.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:53.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:54.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:54.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:54.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:54.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:55.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:55.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:55.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:55.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:56.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:56.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:56.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:56.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:57.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:57.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:57.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:57.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:58.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:58.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:58.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:58.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:57:59.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:59.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:57:59.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:57:59.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:00.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:00.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:00.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:00.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:01.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:01.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:01.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:01.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:02.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:02.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:02.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:03.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:03.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:03.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:03.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:04.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:04.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:04.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:04.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:05.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:05.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:05.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:05.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:06.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:06.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:06.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:06.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:07.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:07.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:07.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:07.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:08.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:08.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:08.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:08.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:09.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:09.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:09.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:09.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:10.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:10.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:10.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:10.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:11.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:11.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:11.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:11.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:12.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:12.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:12.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:12.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:13.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:13.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:13.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:13.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:14.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:14.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:14.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:14.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:15.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:15.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:15.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:15.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:16.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:16.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:16.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:16.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:17.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:17.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:17.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:17.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:18.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:18.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:18.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:18.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:19.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:19.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:19.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:19.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:20.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:20.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:20.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:20.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:21.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:21.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:21.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:21.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:22.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:22.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:22.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:22.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:23.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:23.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:23.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:23.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:24.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:24.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:24.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:24.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:25.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:25.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:25.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:25.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:26.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:26.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:26.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:26.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:27.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:27.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:27.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:27.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:28.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:28.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:28.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:28.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:29.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:29.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:29.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:29.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:30.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:30.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:30.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:30.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:31.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:31.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:31.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:31.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:32.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:32.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:32.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:32.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:33.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:33.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:33.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:33.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:34.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:34.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:34.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:34.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:35.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:35.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:35.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:35.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:36.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:36.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:36.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:36.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:37.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:37.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:37.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:37.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:38.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:38.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:38.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:38.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:39.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:39.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:39.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:39.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:40.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:40.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:40.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:40.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:41.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:41.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:41.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:41.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:42.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:42.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:42.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:42.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:43.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:43.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:43.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:43.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:44.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:44.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:44.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:44.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:45.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:45.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:45.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:45.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:46.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:46.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:46.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:46.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:47.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:47.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:47.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:47.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:48.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:48.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:48.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:48.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:49.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:49.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:49.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:49.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:50.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:50.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:50.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:50.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:51.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:51.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:51.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:51.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:52.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:52.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:52.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:52.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:53.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:53.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:53.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:53.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:54.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:54.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:54.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:54.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:55.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:55.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:55.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:55.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:56.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:56.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:56.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:56.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:57.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:57.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:57.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:57.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:58.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:58.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:58.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:58.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:59.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:58:59.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:58:59.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:58:59.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:00.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:00.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:00.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:00.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:01.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:01.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:01.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:01.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:02.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:02.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:02.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:02.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:03.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:03.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:03.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:03.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:04.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:04.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:04.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:04.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:05.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:05.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:05.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:05.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:06.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:06.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:06.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:06.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:07.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:07.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:07.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:07.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:08.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:08.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:08.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:08.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:09.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:09.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:09.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:09.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:10.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:10.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:10.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:10.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:11.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:11.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:11.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:11.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:12.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:12.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:12.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:12.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:13.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:13.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:13.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:13.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:14.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:14.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:14.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:14.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:15.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:15.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:15.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:15.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:16.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:16.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:16.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:16.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:17.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:17.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:17.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:17.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:18.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:18.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:18.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:18.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:19.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:19.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:19.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:19.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:20.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:20.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:20.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:20.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:21.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:21.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:21.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:21.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:22.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:22.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:22.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:22.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:23.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:23.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:23.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:23.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:24.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:24.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:24.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:24.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:25.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:25.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:25.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:25.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:26.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:26.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:26.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:26.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:27.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:27.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:27.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:27.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:28.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:28.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:28.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:28.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:29.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:29.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:29.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:29.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:30.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:30.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:30.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:30.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:31.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:31.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:31.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:31.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:32.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:32.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:32.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:32.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:33.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:33.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:33.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:33.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:34.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:34.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:34.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:34.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:35.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:35.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:35.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:35.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:36.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:36.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:36.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:36.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:37.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:37.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:37.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:37.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:38.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:38.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:38.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:38.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:39.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:39.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:39.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:39.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:40.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:40.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:40.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:40.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:41.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:41.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:41.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:41.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:42.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:42.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:42.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:42.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:43.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:43.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:43.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:43.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:44.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:44.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:44.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:44.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:45.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:45.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:45.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:45.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:46.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:46.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:46.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:46.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:47.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:47.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:47.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:47.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:48.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:48.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:48.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:48.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:49.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:49.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:49.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:49.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:50.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:50.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:50.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:50.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:51.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:51.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:51.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:51.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:52.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:52.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:52.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:52.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:53.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:53.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:53.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:53.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:54.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:54.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:54.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:54.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:55.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:55.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:55.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:55.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:56.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:56.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:56.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:56.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:57.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:57.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:57.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:57.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:58.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:58.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:58.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:58.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:59.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T17:59:59.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T17:59:59.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T17:59:59.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:00.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:00.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:00.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:00.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:01.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:01.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:01.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:01.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:02.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:02.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:02.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:02.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:03.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:03.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:03.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:03.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:04.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:04.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:04.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:04.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:05.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:05.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:05.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:05.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:06.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:06.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:06.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:06.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:07.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:07.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:07.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:07.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:08.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:08.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:08.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:08.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:09.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:09.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:09.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:09.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:10.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:10.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:10.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:10.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:11.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:11.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:11.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:11.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:12.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:12.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:12.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:12.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:13.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:13.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:13.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:13.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:14.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:14.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:14.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:14.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:15.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:15.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:15.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:15.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:16.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:16.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:16.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:16.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:17.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:17.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:17.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:17.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:18.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:18.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:18.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:18.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:19.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:19.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:19.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:19.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:20.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:20.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:20.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:20.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:21.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:21.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:21.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:21.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:22.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:22.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:22.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:22.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:23.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:23.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:23.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:23.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:24.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:24.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:24.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:24.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:25.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:25.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:25.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:25.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:26.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:26.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:26.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:26.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:27.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:27.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:27.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:27.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:28.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:28.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:28.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:28.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:29.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:29.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:29.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:29.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:30.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:30.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:30.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:30.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:31.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:31.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:31.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:31.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:32.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:32.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:32.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:32.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:33.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:33.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 33 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:33.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:33.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:34.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:34.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:34.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:34.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:35.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:35.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:35.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:35.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:36.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:36.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:36.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:36.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:37.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:37.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:37.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:37.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:38.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:38.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:38.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:38.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:39.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:39.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:39.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:39.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:40.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:40.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:40.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:40.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:41.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:41.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:41.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:41.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:42.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:42.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:42.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:42.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:43.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:43.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:43.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:43.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:44.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:44.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:44.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:44.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:45.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:45.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:45.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:45.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:46.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:46.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:46.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:46.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:47.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:47.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:47.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:47.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:48.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:48.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:48.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:48.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:49.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:49.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:49.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:49.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:50.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:50.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:50.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:50.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:51.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:51.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:51.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:51.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:52.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:52.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:52.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:52.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:53.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:53.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:53.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:53.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:54.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:54.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:54.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:54.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:55.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:55.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:55.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:55.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:56.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:56.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:56.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:56.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:57.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:57.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:57.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:57.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:58.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:58.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:58.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:58.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:00:59.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:00:59.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:00:59.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:00:59.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:00.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:00.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:01:00.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:00.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:01.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:01.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:01:01.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:01.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:02.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:02.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:01:02.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:02.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:03.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:03.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 13 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:01:03.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:03.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:04.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:04.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:04.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:04.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:05.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:05.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:05.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:05.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:06.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:06.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:06.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:06.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:07.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:07.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:07.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:07.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:08.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:08.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:08.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:08.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:09.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:09.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:09.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:09.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:10.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:10.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:10.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:10.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:11.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:11.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:11.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:11.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:12.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:12.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:12.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:12.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:13.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:13.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:13.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:13.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:14.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:14.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:14.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:14.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:15.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:15.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:15.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:15.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:16.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:16.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:16.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:16.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:17.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:17.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:17.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:17.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:18.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:18.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:18.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:18.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:19.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:19.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:19.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:19.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:20.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:20.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:20.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:20.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:21.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:21.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:21.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:21.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:22.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:22.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:22.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:22.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:23.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:23.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:23.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:23.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:24.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:24.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:24.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:24.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:25.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:25.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:25.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:25.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:26.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:26.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:26.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:26.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:27.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:27.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:27.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:27.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:28.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:28.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:28.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:28.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:29.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:29.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:29.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:29.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:30.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:30.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:30.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:30.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:31.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:31.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:31.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:31.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:32.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:32.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:32.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:32.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:33.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:33.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:33.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:33.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:34.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:34.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:34.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:34.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:35.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:35.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:35.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:35.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:36.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:36.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:36.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:36.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:37.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:37.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:37.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:37.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:38.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:38.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:38.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:38.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:39.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:39.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:39.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:39.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:40.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:40.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:40.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:40.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:40.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:40.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:41.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:41.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:41.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:41.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:42.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:42.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:42.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:42.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:43.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:43.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:43.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:44.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:44.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:44.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:45.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:45.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:45.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:45.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:46.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:46.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:46.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:46.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:47.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:47.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:47.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:47.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:48.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:48.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:48.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:48.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:49.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:49.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:49.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:49.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:50.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:50.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:50.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:50.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:51.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:51.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:51.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:51.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:52.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:52.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:52.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:52.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:53.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:53.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:53.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:53.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:54.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:54.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:54.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:54.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:55.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:55.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:55.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:55.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:56.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:56.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:56.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:56.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:57.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:57.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:57.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:57.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:58.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:58.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:58.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:58.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:59.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:01:59.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:01:59.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:01:59.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:00.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:00.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:00.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:00.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:01.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:01.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:01.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:01.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:02.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:02.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:02.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:02.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:03.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:03.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:03.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:03.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:04.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:04.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:04.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:04.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:05.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:05.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:05.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:05.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:06.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:06.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:06.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:06.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:07.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:07.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:07.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:07.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:08.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:08.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:08.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:08.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:08.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:08.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:09.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:09.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:10.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:10.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:10.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:10.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:10.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:10.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:11.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:11.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:11.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:12.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:12.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:12.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:13.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:13.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:13.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:13.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:14.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:14.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:14.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:14.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:15.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:15.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:15.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:15.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:16.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:16.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:16.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:16.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:17.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:17.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:17.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:17.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:18.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:18.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:18.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:18.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:18.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:19.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:19.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:19.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:19.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:20.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:20.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:20.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:20.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:20.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:21.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:21.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:21.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:21.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:22.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:22.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:22.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:22.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:23.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:23.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:23.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:23.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:24.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:24.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:24.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:24.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:25.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:25.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:25.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:25.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:26.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:26.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:26.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:26.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:27.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:27.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:27.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:27.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:28.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:28.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:28.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:28.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:29.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:29.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:29.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:30.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:30.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:30.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:31.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:31.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:31.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:31.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:32.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:32.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:32.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:32.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:33.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:33.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:33.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:33.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:34.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:34.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:34.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:34.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:35.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:35.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:35.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:35.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:36.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:36.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:36.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:36.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:37.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:37.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:37.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:37.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:37.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:37.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:38.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:38.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:38.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:38.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:39.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:39.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:39.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:39.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:40.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:40.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:40.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:40.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:41.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:41.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:41.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:41.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:42.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:42.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:42.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:42.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:43.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:43.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:43.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:43.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:44.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:44.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:44.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:44.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:45.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:45.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:45.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:45.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:46.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:46.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:46.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:46.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:47.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:47.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:47.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:47.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:48.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:48.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:48.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:48.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:49.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:49.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:49.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:49.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:50.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:50.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:50.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:50.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:51.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:51.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:51.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:51.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:52.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:52.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:52.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:52.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:53.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:53.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:53.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:53.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:54.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:54.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:54.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:54.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:55.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:55.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:55.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:55.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:56.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:56.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:56.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:56.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:57.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:57.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:57.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:57.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:58.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:58.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:58.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:58.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:59.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:02:59.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:02:59.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:02:59.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:00.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:00.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:00.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:00.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:01.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:01.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:01.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:01.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:02.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:02.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:02.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:02.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:03.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:03.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:03.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:03.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:04.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:04.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:04.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:04.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:05.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:05.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:05.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:05.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:06.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:06.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:06.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:06.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:07.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:07.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:07.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:07.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:08.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:08.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:08.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:08.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:09.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:09.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:09.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:09.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:10.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:10.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:10.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:10.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:11.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:11.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:11.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:11.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:12.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:12.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:12.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:12.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:13.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:13.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:13.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:13.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:14.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:14.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:14.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:14.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:15.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:15.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:15.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:15.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:16.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:16.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:16.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:16.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:17.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:17.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:17.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:17.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:18.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:18.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:18.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:18.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:19.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:19.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:19.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:19.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:20.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:20.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:20.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:20.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:21.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:21.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:21.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:21.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:22.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:22.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:22.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:22.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:23.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:23.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:23.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:23.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:24.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:24.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:24.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:24.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:25.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:25.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:25.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:25.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:26.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:26.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:26.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:26.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:27.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:27.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:27.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:27.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:28.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:28.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:28.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:28.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:29.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:29.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:29.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:29.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:30.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:30.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:30.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:30.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:31.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:31.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:31.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:31.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:32.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:32.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:32.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:32.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:33.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:33.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:33.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:33.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:34.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:34.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:34.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:35.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:35.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:35.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:35.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:36.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:36.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:36.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:36.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:36.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:37.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:37.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:37.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:38.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:38.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:38.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:39.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:39.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:39.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:39.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:40.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:40.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:40.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:40.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:41.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:41.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:41.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:41.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:42.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:42.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:42.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:42.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:43.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:43.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:43.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:43.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:44.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:44.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:44.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:44.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:45.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:45.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:45.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:45.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:46.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:46.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:46.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:46.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:47.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:47.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:47.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:47.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:48.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:48.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:48.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:48.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:49.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:49.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:49.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:49.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:50.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:50.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:50.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:50.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:51.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:51.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:51.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:51.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:52.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:52.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:52.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:52.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:53.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:53.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:53.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:53.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:54.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:54.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:54.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:54.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:55.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:55.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:55.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:55.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:56.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:56.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:56.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:56.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:57.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:57.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:57.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:57.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:58.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:58.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:58.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:58.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:59.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:03:59.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:03:59.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:03:59.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:00.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:00.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:00.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:00.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:01.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:01.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:01.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:01.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:02.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:02.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:02.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:02.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:03.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:03.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:03.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:03.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:04.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:04.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:04.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:04.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:05.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:05.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:05.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:05.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:06.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:06.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:06.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:06.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:07.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:07.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:07.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:07.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:08.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:08.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:08.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:08.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:09.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:09.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:09.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:09.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:10.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:10.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:10.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:10.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:11.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:11.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:11.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:11.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:12.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:12.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:12.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:12.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:13.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:13.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:13.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:13.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:14.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:14.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:14.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:14.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:15.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:15.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:15.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:15.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:16.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:16.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:16.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:16.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:17.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:17.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:17.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:17.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:18.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:18.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:18.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:18.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:19.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:19.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:19.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:19.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:20.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:20.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:20.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:20.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:21.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:21.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:21.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:21.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:22.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:22.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:22.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:22.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:23.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:23.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:23.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:23.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:24.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:24.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:24.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:24.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:25.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:25.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:25.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:25.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:26.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:26.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:26.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:26.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:27.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:27.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:27.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:27.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:28.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:28.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:28.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:28.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:29.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:29.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:29.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:29.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:30.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:30.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:30.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:30.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:31.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:31.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:31.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:31.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:32.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:32.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:32.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:32.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:33.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:33.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:33.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:33.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:34.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:34.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:34.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:34.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:35.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:35.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:35.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:35.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:36.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:36.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:36.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:36.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:37.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:37.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:37.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:37.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:38.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:38.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:38.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:38.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:39.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:39.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:39.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:39.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:40.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:40.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:40.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:40.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:41.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:41.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:41.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:41.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:42.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:42.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:42.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:42.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:43.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:43.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:43.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:43.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:44.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:44.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:44.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:44.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:45.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:45.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:45.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:45.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:46.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:46.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:46.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:46.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:47.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:47.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:47.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:47.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:48.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:48.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:48.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:48.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:49.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:49.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:49.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:49.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:49.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:50.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:50.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:50.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:51.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:51.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:51.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:51.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:51.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:52.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:52.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:52.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:52.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:53.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:53.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:53.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:54.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:54.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:54.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:54.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:54.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:55.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:55.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:55.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:56.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:56.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:56.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:56.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:57.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:57.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:57.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:57.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:58.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:58.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:58.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:58.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:59.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:04:59.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:04:59.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:04:59.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:00.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:00.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:00.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:00.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:01.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:01.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:01.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:01.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:01.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:02.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:02.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:02.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:02.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:02.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:03.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:03.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:04.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:04.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:04.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:04.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:04.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:04.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:05.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:05.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:05.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:05.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:06.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:06.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:06.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:06.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:07.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:07.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:08.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:08.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:08.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:08.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:09.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:09.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:09.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:09.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:10.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:10.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:10.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:10.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:11.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:11.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:11.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:11.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:12.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:12.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:12.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:12.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:13.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:13.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:13.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:13.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:14.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:14.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:14.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:14.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:15.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:15.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:15.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:15.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:16.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:16.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:16.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:16.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:17.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:17.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:17.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:17.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:18.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:18.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:18.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:18.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:19.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:19.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:19.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:19.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:20.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:20.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:20.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:20.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:21.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:21.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:21.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:21.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:22.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:22.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:22.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:22.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:23.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:23.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:23.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:23.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:24.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:24.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:24.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:24.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:25.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:25.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:25.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:25.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:26.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:26.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:26.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:26.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:27.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:27.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:27.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:27.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:28.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:28.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:28.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:28.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:29.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:29.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:29.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:29.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:30.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:30.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:30.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:30.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:31.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:31.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:31.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:31.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:32.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:32.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:32.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:32.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:33.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:33.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:33.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:33.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:33.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:34.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:34.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:34.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:34.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:35.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:35.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:35.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:35.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:36.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:36.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:36.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:37.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:37.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:37.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:37.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:38.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:38.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:38.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:38.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:39.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:39.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:39.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:39.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:40.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:40.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:40.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:40.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:41.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:41.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:41.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:41.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:42.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:42.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:42.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:42.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:43.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:43.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:43.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:43.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:44.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:44.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:44.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:44.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:45.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:45.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:45.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:45.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:46.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:46.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:46.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:46.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:47.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:47.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:47.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:47.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:48.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:48.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:48.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:48.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:49.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:49.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:49.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:49.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:50.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:50.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:50.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:50.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:51.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:51.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:51.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:51.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:52.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:52.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:52.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:52.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:53.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:53.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:53.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:53.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:54.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:54.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:54.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:54.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:55.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:55.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:55.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:55.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:56.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:56.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:56.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:56.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:57.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:57.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:57.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:57.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:58.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:58.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:58.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:58.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:59.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:05:59.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:05:59.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:05:59.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:00.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:00.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:00.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:00.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:01.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:01.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:01.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:01.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:02.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:02.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:02.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:02.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:03.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:03.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:03.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:03.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:03.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:04.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:04.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:04.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:05.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:05.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:05.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:05.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:06.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:06.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:06.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:06.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:07.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:07.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:07.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:07.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:08.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:08.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:08.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:08.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:09.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:09.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:09.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:09.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:10.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:10.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:10.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:10.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:11.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:11.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:11.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:11.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:12.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:12.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:12.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:12.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:13.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:13.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:13.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:13.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:14.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:14.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:14.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:14.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:15.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:15.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:15.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:15.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:16.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:16.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:16.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:16.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:17.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:17.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:17.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:17.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:18.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:18.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:18.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:18.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:19.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:19.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:19.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:19.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:20.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:20.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:20.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:20.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:21.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:21.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:21.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:21.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:22.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:22.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:22.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:22.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:23.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:23.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:23.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:23.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:24.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:24.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:24.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:24.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:25.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:25.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:25.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:25.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:26.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:26.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:26.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:26.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:27.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:27.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:27.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:27.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:28.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:28.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:28.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:28.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:29.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:29.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:29.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:29.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:30.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:30.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:30.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:30.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:31.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:31.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:31.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:31.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:32.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:32.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:32.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:32.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:33.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:33.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:33.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:33.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:34.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:34.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:34.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:34.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:35.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:35.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:35.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:35.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:36.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:36.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:36.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:36.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:37.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:37.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:37.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:37.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:38.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:38.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:38.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:38.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:39.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:39.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:39.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:39.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:40.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:40.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:40.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:40.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:41.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:41.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:41.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:41.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:42.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:42.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:42.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:42.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:43.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:43.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:43.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:43.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:44.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:44.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:44.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:44.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:45.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:45.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:45.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:45.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:46.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:46.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:46.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:46.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:47.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:47.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:47.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:47.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:48.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:48.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:48.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:48.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:49.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:49.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:49.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:49.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:50.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:50.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:50.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:50.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:51.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:51.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:51.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:51.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:52.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:52.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:52.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:52.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:53.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:53.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:53.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:53.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:54.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:54.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:54.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:54.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:55.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:55.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:55.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:55.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:56.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:56.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:56.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:56.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:57.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:57.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:57.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:57.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:58.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:58.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:58.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:58.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:59.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:06:59.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:06:59.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:06:59.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:00.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:00.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:00.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:00.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:01.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:01.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:01.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:01.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:02.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:02.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:02.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:02.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:03.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:03.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:03.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:03.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:04.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:04.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:04.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:04.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:05.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:05.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:05.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:05.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:06.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:06.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:06.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:06.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:07.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:07.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:07.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:07.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:08.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:08.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:08.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:08.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:09.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:09.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:09.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:09.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:10.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:10.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:10.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:10.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:11.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:11.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:11.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:11.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:12.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:12.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:12.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:12.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:13.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:13.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:13.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:13.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:14.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:14.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:14.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:14.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:15.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:15.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:15.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:15.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:15.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:16.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:16.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:16.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:16.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:16.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:17.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:17.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:18.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:18.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:18.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:18.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:19.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:19.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:19.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:19.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:20.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:20.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:20.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:20.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:21.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:21.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:21.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:21.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:22.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:22.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:22.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:22.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:23.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:23.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:23.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:23.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:24.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:24.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:24.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:24.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:24.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:25.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:25.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:25.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:25.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:25.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:26.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:26.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:26.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:26.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:27.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:27.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:27.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:27.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:28.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:28.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:28.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:28.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:29.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:29.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:30.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:30.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:30.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:30.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:31.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:31.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:31.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:31.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:32.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:32.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:32.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:32.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:33.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:33.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:33.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:33.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:34.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:34.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:34.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:34.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:35.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:35.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:35.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:35.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:36.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:36.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:36.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:36.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:37.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:37.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:37.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:37.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:38.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:38.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:38.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:38.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:39.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:39.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:39.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:39.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:40.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:40.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:40.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:40.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:41.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:41.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:41.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:41.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:42.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:42.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:42.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:42.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:43.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:43.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:43.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:43.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:44.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:44.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:44.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:44.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:45.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:45.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:45.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:45.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:46.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:46.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:46.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:46.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:47.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:47.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:47.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:47.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:48.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:48.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:48.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:48.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:49.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:49.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:49.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:49.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:50.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:50.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:50.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:50.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:51.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:51.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:51.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:51.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:52.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:52.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:52.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:52.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:53.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:53.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:53.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:53.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:54.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:54.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:54.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:54.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:55.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:55.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:55.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:55.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:56.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:56.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:56.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:56.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:57.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:57.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:57.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:57.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:58.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:58.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:58.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:58.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:59.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:07:59.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:07:59.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:07:59.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:00.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:00.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:00.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:00.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:01.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:01.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:01.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:01.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:02.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:02.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:02.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:02.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:03.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:03.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:03.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:03.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:04.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:04.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:04.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:04.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:05.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:05.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:05.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:05.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:06.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:06.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:06.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:06.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:07.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:07.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:07.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:07.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:08.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:08.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:08.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:08.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:09.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:09.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:09.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:09.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:10.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:10.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:10.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:10.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:11.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:11.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:11.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:11.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:12.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:12.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:12.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:12.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:13.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:13.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:13.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:13.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:14.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:14.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:14.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:14.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:15.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:15.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:15.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:15.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:16.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:16.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:16.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:16.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:17.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:17.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:17.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:17.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:18.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:18.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:18.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:18.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:19.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:19.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:19.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:19.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:20.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:20.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:20.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:20.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:21.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:21.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:21.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:21.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:21.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:22.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:22.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:22.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:23.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:23.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:23.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:23.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:24.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:24.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:24.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:24.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:25.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:25.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:25.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:25.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:26.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:26.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:26.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:26.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:27.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:27.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:27.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:27.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:27.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:28.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:28.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:28.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:29.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:29.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:29.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:29.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:30.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:30.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:30.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:30.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:31.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:31.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:31.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:31.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:32.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:32.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:32.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:32.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:33.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:33.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:33.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:33.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:33.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:33.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:34.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:34.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:34.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:34.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:35.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:35.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:35.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:36.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:36.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:36.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:37.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:37.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:37.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:37.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:38.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:38.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:38.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:38.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:39.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:39.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:39.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:39.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:40.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:40.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:40.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:40.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:41.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:41.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:41.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:41.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:42.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:42.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:42.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:42.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:43.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:43.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:43.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:43.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:44.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:44.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:44.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:44.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:45.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:45.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:45.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:45.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:46.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:46.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:46.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:46.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:47.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:47.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:47.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:47.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:48.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:48.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:48.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:48.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:49.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:49.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:49.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:49.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:50.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:50.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:50.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:50.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:51.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:51.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:51.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:51.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:52.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:52.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:52.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:52.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:53.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:53.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:53.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:53.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:54.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:54.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:54.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:54.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:55.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:55.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:55.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:55.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:56.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:56.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:56.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:56.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:57.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:57.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:57.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:57.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:58.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:58.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:58.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:59.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:59.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:08:59.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:08:59.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:08:59.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:00.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:00.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:00.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:00.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:01.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:01.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:01.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:01.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:02.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:02.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:02.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:02.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:03.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:03.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:03.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:03.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:04.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:04.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:04.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:04.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:05.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:05.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:05.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:05.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:06.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:06.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:07.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:07.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:07.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:07.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:08.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:08.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:08.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:08.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:09.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:09.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:09.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:09.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:10.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:10.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:10.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:10.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:11.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:11.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:11.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:11.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:11.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:12.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:12.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:12.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:13.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:13.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:13.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:13.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:14.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:14.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:14.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:14.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:15.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:15.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:15.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:15.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:15.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:16.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:16.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:16.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:16.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:16.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:17.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:17.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:18.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:18.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:18.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:18.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:18.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:19.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:19.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:19.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:19.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:19.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:20.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:20.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:20.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:20.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:21.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:21.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:21.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:21.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:22.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:22.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:22.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:22.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:23.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:23.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:23.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:23.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:24.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:24.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:24.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:25.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:25.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:25.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:25.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:25.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:26.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:26.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:26.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:26.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:27.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:27.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:27.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:27.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:28.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:28.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:28.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:28.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:29.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:29.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:29.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:29.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:30.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:30.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:30.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:31.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:31.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:31.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:31.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:31.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:32.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:32.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:32.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:32.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:33.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:33.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:33.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:33.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:34.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:34.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:34.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:34.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:35.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:35.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:35.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:35.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:36.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:36.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:36.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:36.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:37.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:37.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:37.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:37.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:38.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:38.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:39.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:39.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:39.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:39.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:40.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:40.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:40.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:40.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:40.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:41.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:41.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:41.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:41.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:42.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:42.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:42.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:43.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:43.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:43.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:43.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:44.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:44.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:44.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:44.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:45.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:45.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:45.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:45.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:46.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:46.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:46.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:46.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:47.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:47.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:47.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:47.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:48.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:48.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:48.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:48.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:49.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:49.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:49.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:49.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:49.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:50.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:50.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:50.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:51.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:51.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:51.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:51.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:51.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:51.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:52.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:52.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:52.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:52.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:53.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:53.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:54.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:54.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:54.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:54.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:55.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:55.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:55.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:55.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:56.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:56.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:56.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:56.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:57.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:57.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:57.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:57.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:58.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:58.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:58.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:58.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:59.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:09:59.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:09:59.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:09:59.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:00.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:00.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:00.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:00.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:00.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:00.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:01.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:01.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:01.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:01.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:02.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:02.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:02.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:02.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:03.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:03.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:03.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:03.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:04.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:04.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:04.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:04.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:05.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:05.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:06.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:06.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:06.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:06.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:06.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:06.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:07.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:07.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:07.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:07.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:08.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:08.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:08.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:08.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:09.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:09.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:09.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:09.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:10.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:10.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:10.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:10.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:11.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:11.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:11.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:11.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:12.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:12.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:12.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:12.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:13.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:13.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:13.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:13.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:14.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:14.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:14.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:14.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:15.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:15.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:15.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:15.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:16.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:16.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:16.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:16.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:17.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:17.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:17.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:17.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:18.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:18.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:18.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:18.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:18.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:19.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:19.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:19.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:19.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:20.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:20.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:20.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:20.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:21.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:21.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:21.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:22.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:22.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:22.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:22.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:23.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:23.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:23.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:23.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:24.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:24.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:24.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:24.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:25.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:25.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:25.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:26.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:26.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:26.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:27.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:27.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:27.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:27.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:27.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:28.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:28.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:28.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:28.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:28.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:29.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:29.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:29.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:29.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:30.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:30.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:30.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:30.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:31.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:31.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:31.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:31.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:32.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:32.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:32.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:32.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:33.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:33.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:33.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:33.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:34.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:34.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:34.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:34.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:35.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:35.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:35.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:35.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:36.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:36.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:36.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:36.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:37.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:37.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:37.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:37.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:38.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:38.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:38.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:38.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:39.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:39.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:39.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:39.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:40.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:40.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:40.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:40.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:41.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:41.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:41.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:41.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:42.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:42.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:42.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:42.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:43.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:43.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:43.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:43.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:44.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:44.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:44.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:44.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:45.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:45.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:45.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:45.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:46.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:46.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:46.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:46.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:47.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:47.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:47.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:47.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:48.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:48.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:48.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:48.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:49.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:49.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:49.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:49.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:50.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:50.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:50.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:50.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:51.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:51.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:51.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:51.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:52.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:52.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:52.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:52.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:53.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:53.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:53.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:53.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:54.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:54.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:54.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:54.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:55.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:55.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:55.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:55.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:56.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:56.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:56.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:57.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:57.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:57.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:57.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:57.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:58.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:58.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:58.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:58.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:59.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:10:59.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:10:59.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:10:59.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:00.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:00.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:00.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:00.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:01.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:01.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:01.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:01.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:02.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:02.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:02.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:02.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:03.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:03.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:03.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:03.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:04.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:04.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:04.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:05.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:05.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:05.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:06.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:06.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:06.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:06.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:06.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:07.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:07.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:07.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:08.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:08.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:08.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:08.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:09.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:09.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:09.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:09.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:10.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:10.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:10.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:10.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:11.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:11.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:11.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:11.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:12.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:12.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:12.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:12.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:13.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:13.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:13.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:13.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:14.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:14.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:14.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:14.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:15.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:15.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:15.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:15.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:16.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:16.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:16.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:16.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:16.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:17.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:17.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:17.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:17.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:17.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:18.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:18.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:19.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:19.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:19.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:19.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:19.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:19.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:20.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:20.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:20.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:20.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:21.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:21.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:21.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:21.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:22.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:22.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:22.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:22.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:23.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:23.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:23.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:24.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:24.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:24.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:25.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:25.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:25.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:25.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:26.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:26.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:26.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:26.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:27.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:27.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:27.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:27.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:28.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:28.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:28.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:28.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:29.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:29.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:29.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:29.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:30.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:30.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:30.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:30.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:31.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:31.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:31.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:31.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:32.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:32.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:32.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:32.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:33.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:33.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:33.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:33.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:34.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:34.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:34.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:34.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:35.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:35.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:35.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:35.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:36.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:36.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:36.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:36.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:37.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:37.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:37.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:37.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:38.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:38.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:38.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:38.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:39.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:39.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:39.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:39.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:40.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:40.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:40.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:40.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:40.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:40.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:41.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:41.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:42.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:42.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:42.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:42.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:43.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:43.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:43.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:43.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:44.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:44.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:44.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:44.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:45.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:45.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:45.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:45.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:46.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:46.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:46.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:46.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:47.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:47.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:47.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:47.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:48.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:48.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:48.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:48.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:49.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:49.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:49.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:49.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:50.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:50.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:50.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:50.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:51.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:51.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:51.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:51.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:52.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:52.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:52.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:52.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:53.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:53.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:53.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:53.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:54.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:54.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:54.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:54.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:55.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:55.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:55.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:55.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:56.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:56.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:56.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:56.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:57.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:57.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:57.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:57.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:58.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:58.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:58.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:58.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:59.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:11:59.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:11:59.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:11:59.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:00.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:00.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:00.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:00.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:01.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:01.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:01.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:01.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:02.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:02.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:02.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:02.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:03.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:03.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:03.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:03.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:04.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:04.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:04.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:04.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:05.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:05.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:05.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:05.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:06.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:06.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:06.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:06.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:07.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:07.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:07.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:07.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:08.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:08.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:08.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:08.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:09.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:09.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:09.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:09.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:10.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:10.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:10.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:10.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:11.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:11.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:11.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:11.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:12.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:12.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:12.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:12.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:13.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:13.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:13.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:13.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:14.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:14.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:14.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:14.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:15.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:15.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:15.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:15.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:16.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:16.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:16.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:16.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:17.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:17.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:17.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:17.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:18.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:18.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:18.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:18.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:19.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:19.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:19.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:19.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:20.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:20.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:20.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:20.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:21.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:21.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:21.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:21.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:22.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:22.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:22.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:22.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:22.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:23.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:23.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:23.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:23.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:23.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:24.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:24.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:24.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:24.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:25.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:25.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:25.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:25.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:26.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:26.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:26.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:26.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:27.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:27.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:27.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:27.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:28.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:28.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:28.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:28.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:29.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:29.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:29.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:29.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:30.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:30.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:30.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:30.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:31.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:31.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:31.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:31.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:32.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:32.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:32.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:32.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:33.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:33.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:33.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:33.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:34.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:34.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:34.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:34.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:35.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:35.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:35.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:35.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:36.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:36.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:36.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:36.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:37.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:37.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:37.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:37.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:38.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:38.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:38.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:38.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:39.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:39.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:39.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:39.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:40.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:40.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:40.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:40.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:41.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:41.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:41.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:41.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:42.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:42.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:42.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:42.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:43.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:43.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:43.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:43.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:44.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:44.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:44.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:44.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:45.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:45.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:45.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:45.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:46.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:46.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:46.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:46.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:47.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:47.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:47.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:47.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:48.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:48.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:48.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:48.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:49.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:49.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:49.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:49.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:50.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:50.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:50.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:50.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:51.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:51.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:51.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:51.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:52.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:52.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:52.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:52.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:53.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:53.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:53.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:53.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:54.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:54.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:54.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:54.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:55.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:55.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:56.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:56.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:56.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:56.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:56.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:56.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:57.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:57.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:57.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:57.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:58.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:58.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:58.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:58.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:59.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:12:59.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:12:59.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:12:59.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:00.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:00.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:00.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:00.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:01.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:01.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:01.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:01.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:02.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:02.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:02.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:02.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:03.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:03.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:03.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:03.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:04.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:04.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:04.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:04.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:05.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:05.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:05.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:05.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:06.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:06.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:06.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:06.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:07.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:07.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:07.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:07.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:08.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:08.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:08.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:08.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:09.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:09.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:09.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:09.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:10.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:10.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:10.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:10.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:11.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:11.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:11.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:11.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:12.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:12.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:12.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:12.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:13.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:13.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:13.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:13.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:14.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:14.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:14.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:14.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:15.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:15.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:15.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:15.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:16.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:16.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:16.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:16.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:17.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:17.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:17.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:17.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:18.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:18.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:18.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:18.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:19.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:19.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:19.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:19.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:20.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:20.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:20.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:20.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:21.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:21.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:21.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:21.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:22.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:22.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:22.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:22.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:23.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:23.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:23.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:23.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:24.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:24.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:24.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:24.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:25.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:25.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:25.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:25.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:26.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:26.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:26.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:26.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:27.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:27.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:27.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:27.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:28.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:28.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:28.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:28.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:29.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:29.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:29.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:29.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:30.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:30.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:30.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:30.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:31.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:31.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:31.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:31.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:32.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:32.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:32.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:32.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:33.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:33.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:33.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:33.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:34.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:34.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:34.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:34.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:35.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:35.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:35.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:35.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:36.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:36.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:36.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:36.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:37.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:37.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:37.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:37.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:38.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:38.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:38.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:38.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:39.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:39.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:39.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:39.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:40.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:40.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:40.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:40.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:41.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:41.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:41.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:41.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:42.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:42.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:42.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:42.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:43.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:43.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:43.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:43.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:44.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:44.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:44.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:44.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:45.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:45.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:45.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:45.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:46.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:46.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:46.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:46.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:47.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:47.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:47.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:47.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:48.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:48.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:48.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:48.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:49.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:49.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:49.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:49.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:50.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:50.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:50.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:50.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:51.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:51.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:51.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:51.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:52.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:52.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:52.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:52.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:53.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:53.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:53.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:53.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:54.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:54.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:54.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:54.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:55.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:55.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:55.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:55.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:56.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:56.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:56.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:56.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:57.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:57.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:57.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:57.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:58.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:58.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:58.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:58.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:59.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:13:59.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:13:59.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:13:59.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:00.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:00.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:01.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:01.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:01.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:01.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:01.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:02.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:02.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:02.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:02.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:02.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:03.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:03.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:03.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:03.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:04.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:04.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:04.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:05.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:05.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:05.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:05.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:05.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:06.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:06.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:06.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:06.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:07.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:07.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:07.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:07.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:08.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:08.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:08.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:08.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:09.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:09.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:09.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:09.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:10.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:10.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:10.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:10.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:11.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:11.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:11.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:11.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:12.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:12.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:12.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:12.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:13.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:13.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:13.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:13.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:14.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:14.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:14.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:14.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:15.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:15.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:15.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:15.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:16.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:16.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:16.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:17.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:17.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:17.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:18.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:18.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:18.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:18.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:19.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:19.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:19.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:19.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:20.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:20.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:20.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:20.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:21.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:21.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:21.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:21.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:21.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:21.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:22.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:22.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:23.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:23.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:23.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:23.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:24.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:24.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:24.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:24.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:24.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:25.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:25.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:25.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:26.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:26.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:26.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:26.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:27.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:27.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:27.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:27.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:28.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:28.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:28.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:28.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:29.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:29.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:29.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:29.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:30.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:30.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:30.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:30.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:31.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:31.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:31.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:31.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:31.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:31.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:32.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:32.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:32.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:32.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:33.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:33.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:33.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:33.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:34.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:34.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:34.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:34.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:35.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:35.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:35.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:35.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:36.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:36.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:36.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:37.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:37.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:37.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:37.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:37.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:38.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:38.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:39.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:39.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:39.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:39.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:39.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:39.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:40.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:40.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:40.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:40.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:41.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:41.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:41.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:41.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:42.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:42.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:42.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:42.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:43.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:43.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:43.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:43.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:44.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:44.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:44.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:44.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:45.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:45.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:45.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:45.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:46.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:46.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:46.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:46.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:47.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:47.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:47.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:47.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:48.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:48.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:48.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:48.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:49.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:49.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:49.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:50.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:50.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:50.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:50.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:50.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:51.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:51.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:51.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:51.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:52.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:52.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:52.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:52.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:53.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:53.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:53.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:53.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:54.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:54.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:54.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:54.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:55.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:55.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:55.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:56.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:56.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:56.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:57.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:57.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:57.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:57.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:58.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:58.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:58.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:58.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:58.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:58.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:59.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:14:59.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:14:59.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:14:59.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:00.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:00.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:00.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:00.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:01.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:01.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:02.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:02.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:02.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:02.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:03.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:03.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:03.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:03.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:04.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:04.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:04.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:04.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:05.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:05.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:05.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:05.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:06.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:06.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:06.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:06.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:06.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:06.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:07.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:07.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:08.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:08.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:08.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:08.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:09.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:09.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:09.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:09.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:10.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:10.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:10.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:10.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:10.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:11.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:11.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:11.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:11.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:11.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:12.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:12.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:12.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:12.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:13.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:13.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:13.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:13.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:14.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:14.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:14.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:14.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:15.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:15.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:15.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:15.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:16.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:16.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:16.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:16.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:17.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:17.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:17.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:17.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:18.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:18.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:18.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:18.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:19.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:19.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:19.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:19.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:20.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:20.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:20.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:20.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:21.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:21.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:21.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:21.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:22.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:22.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:22.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:22.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:23.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:23.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:23.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:23.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:24.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:24.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:25.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:25.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:25.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:25.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:26.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:26.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:26.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:26.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:27.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:27.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:27.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:27.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:28.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:28.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:28.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:28.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:28.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:29.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:29.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:29.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:29.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:30.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:30.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:30.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:31.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:31.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:31.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:31.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:32.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:32.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:32.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:32.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:33.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:33.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 36 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:33.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:33.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:34.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:34.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:34.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:34.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:35.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:35.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:35.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:35.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:36.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:36.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:36.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:36.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:37.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:37.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:37.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:37.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:38.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:38.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:38.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:38.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:39.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:39.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:39.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:39.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:40.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:40.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:40.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:40.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:41.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:41.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:41.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:41.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:41.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:41.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:42.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:42.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:42.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:42.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:43.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:43.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:43.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:43.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:44.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:44.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:44.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:44.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:45.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:45.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:45.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:45.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:46.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:46.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:46.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:46.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:47.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:47.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:47.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:47.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:48.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:48.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:48.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:48.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:49.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:49.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:49.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:49.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:50.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:50.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:50.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:50.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:51.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:51.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:51.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:51.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:52.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:52.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:52.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:52.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:53.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:53.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:53.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:53.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:54.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:54.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:54.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:54.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:55.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:55.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:55.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:55.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:56.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:56.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:56.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:56.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:57.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:57.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:57.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:57.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:58.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:58.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:58.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:58.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:15:59.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:15:59.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:15:59.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:15:59.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:00.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:00.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:16:00.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:00.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:01.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:01.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:16:01.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:01.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:02.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:02.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 1 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:16:02.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:02.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:03.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:03.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:03.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:03.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:04.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:04.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:04.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:04.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:05.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:05.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:05.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:05.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:06.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:06.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:06.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:06.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:07.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:07.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:07.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:07.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:08.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:08.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:08.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:08.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:09.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:09.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:09.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:09.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:10.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:10.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:10.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:10.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:11.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:11.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:11.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:11.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:12.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:12.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:12.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:12.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:13.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:13.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:13.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:13.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:14.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:14.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:14.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:14.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:15.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:15.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:15.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:15.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:16.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:16.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:16.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:16.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:17.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:17.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:17.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:17.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:18.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:18.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:18.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:18.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:19.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:19.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:19.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:19.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:20.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:20.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:20.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:20.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:21.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:21.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:21.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:21.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:22.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:22.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:22.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:22.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:23.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:23.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:23.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:23.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:24.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:24.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:24.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:24.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:25.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:25.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:25.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:25.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:26.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:26.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:26.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:26.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:27.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:27.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:27.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:27.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:28.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:28.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:28.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:28.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:29.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:29.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:29.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:29.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:30.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:30.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:30.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:30.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:31.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:31.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:31.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:31.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:32.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:32.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:32.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:32.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:33.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:33.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:33.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:33.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:34.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:34.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:34.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:34.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:35.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:35.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:35.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:35.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:36.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:36.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:36.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:36.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:37.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:37.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:37.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:37.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:38.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:38.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:38.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:38.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:39.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:39.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:39.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:39.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:40.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:40.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:41.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:41.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:41.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:41.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:42.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:42.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:42.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:42.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:43.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:43.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:43.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:43.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:44.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:44.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:44.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:44.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:45.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:45.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:45.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:45.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:46.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:46.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:46.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:46.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:47.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:47.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:47.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:47.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:48.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:48.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:48.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:48.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:49.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:49.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:49.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:49.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:50.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:50.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:50.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:50.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:51.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:51.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:51.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:51.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:52.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:52.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:52.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:52.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:53.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:53.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:53.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:53.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:54.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:54.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:54.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:54.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:55.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:55.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:55.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:55.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:56.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:56.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:56.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:56.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:57.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:57.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:57.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:57.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:58.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:58.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:58.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:58.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:59.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:16:59.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:16:59.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:16:59.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:00.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:00.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:00.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:00.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:01.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:01.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:01.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:01.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:02.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:02.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:02.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:02.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:03.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:03.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:03.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:03.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:04.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:04.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:04.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:04.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:05.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:05.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:05.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:05.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:06.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:06.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:06.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:06.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:07.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:07.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:07.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:07.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:08.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:08.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:08.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:08.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:09.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:09.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:09.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:09.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:10.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:10.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:10.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:10.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:11.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:11.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:11.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:11.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:12.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:12.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:12.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:12.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:13.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:13.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:13.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:13.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:14.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:14.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:14.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:14.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:15.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:15.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:15.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:15.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:16.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:16.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:16.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:16.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:17.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:17.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:17.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:17.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:18.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:18.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:18.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:18.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:19.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:19.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:19.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:19.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:20.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:20.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:20.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:20.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:21.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:21.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:21.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:21.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:22.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:22.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:22.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:22.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:23.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:23.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:23.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:23.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:24.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:24.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:24.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:24.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:25.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:25.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:25.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:25.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:26.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:26.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:26.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:26.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:27.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:27.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:27.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:27.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:28.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:28.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:28.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:28.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:29.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:29.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:29.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:29.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:30.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:30.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:30.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:30.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:31.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:31.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:31.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:31.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:32.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:32.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:32.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:32.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:33.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:33.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:33.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:33.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:34.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:34.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:34.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:34.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:35.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:35.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:35.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:35.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:36.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:36.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:36.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:36.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:37.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:37.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:37.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:37.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:38.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:38.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:38.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:38.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:38.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:39.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:39.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:39.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:39.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:39.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:40.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:40.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:40.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:40.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:41.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:41.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:42.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:42.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:42.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:42.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:42.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:43.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:43.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:43.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:44.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:44.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:44.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:44.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:45.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:45.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:45.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:45.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:46.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:46.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:46.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:46.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:47.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:47.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:47.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:47.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:48.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:48.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:48.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:48.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:49.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:49.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:49.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:49.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:50.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:50.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:50.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:50.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:51.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:51.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:51.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:51.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:52.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:52.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:52.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:52.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:53.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:53.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:53.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:53.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:54.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:54.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:54.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:54.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:55.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:55.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:55.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:55.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:56.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:56.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:56.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:56.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:57.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:57.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:57.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:57.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:58.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:58.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:58.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:58.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:59.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:17:59.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:17:59.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:17:59.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:00.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:00.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:00.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:00.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:01.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:01.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:01.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:01.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:02.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:02.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:02.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:02.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:03.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:03.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:03.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:03.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:04.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:04.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:04.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:04.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:05.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:05.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:05.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:05.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:06.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:06.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:06.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:06.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:07.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:07.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:07.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:07.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:08.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:08.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:08.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:08.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:09.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:09.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:09.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:09.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:10.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:10.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:10.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:10.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:11.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:11.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:11.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:11.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:12.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:12.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:12.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:12.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:13.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:13.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:13.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:13.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:14.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:14.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:14.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:14.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:15.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:15.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:15.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:15.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:16.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:16.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:16.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:16.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:17.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:17.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:17.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:17.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:18.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:18.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:18.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:18.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:19.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:19.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:19.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:19.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:20.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:20.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:20.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:20.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:20.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:21.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:21.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:21.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:22.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:22.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:22.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:22.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:23.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:23.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:23.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:23.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:23.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:23.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:24.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:24.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:24.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:24.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:25.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:25.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:25.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:25.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:26.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:26.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:26.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:26.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:27.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:27.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:27.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:27.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:28.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:28.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:28.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:28.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:29.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:29.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:29.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:29.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:30.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:30.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:30.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:30.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:31.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:31.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:31.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:31.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:32.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:32.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:32.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:32.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:33.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:33.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:33.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:33.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:34.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:34.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:34.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:34.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:35.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:35.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:35.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:35.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:36.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:36.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:36.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:36.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:37.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:37.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:37.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:37.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:38.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:38.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:38.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:39.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:39.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:39.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:40.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:40.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:40.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:40.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:40.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:40.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:41.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:41.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:42.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:42.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:42.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:42.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:42.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:42.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:43.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:43.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:43.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:43.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:44.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:44.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:45.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:45.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:45.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:45.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:46.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:46.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:46.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:46.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:47.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:47.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:47.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:47.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:48.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:48.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:48.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:48.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:48.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:48.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:49.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:49.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:50.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:50.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:50.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:50.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:51.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:51.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:51.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:51.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:52.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:52.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:52.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:52.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:52.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:53.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:53.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:53.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:53.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:53.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:54.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:54.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:54.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:54.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:55.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:55.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:55.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:55.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:56.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:56.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:56.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:56.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:57.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:57.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:57.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:57.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:58.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:58.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:58.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:58.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:59.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:18:59.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:18:59.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:18:59.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:00.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:00.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:00.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:00.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:01.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:01.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:01.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:01.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:02.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:02.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:02.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:02.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:03.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:03.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:03.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:03.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:04.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:04.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:04.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:04.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:05.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:05.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:05.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:05.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:06.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:06.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:06.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:06.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:07.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:07.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:07.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:07.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:08.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:08.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:08.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:08.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:09.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:09.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:09.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:09.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:10.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:10.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:10.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:10.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:11.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:11.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:11.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:11.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:12.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:12.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:12.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:12.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:13.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:13.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:13.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:13.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:14.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:14.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:14.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:14.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:15.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:15.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:15.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:15.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:16.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:16.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:16.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:16.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:17.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:17.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:17.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:17.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:18.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:18.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:18.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:18.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:19.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:19.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:19.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:19.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:20.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:20.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:20.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:20.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:21.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:21.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:21.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:21.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:22.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:22.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:22.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:22.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:23.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:23.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:23.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:23.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:24.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:24.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:24.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:24.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:25.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:25.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:25.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:25.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:26.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:26.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:26.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:26.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:27.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:27.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:27.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:27.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:28.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:28.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:28.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:28.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:29.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:29.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:29.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:29.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:30.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:30.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:30.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:30.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:31.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:31.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:31.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:31.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:32.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:32.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:32.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:32.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:33.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:33.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:33.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:33.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:34.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:34.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:34.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:34.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:35.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:35.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:35.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:35.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:36.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:36.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:36.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:36.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:37.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:37.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:37.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:37.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:38.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:38.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:38.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:38.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:39.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:39.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:39.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:39.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:40.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:40.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:40.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:40.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:41.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:41.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:41.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:41.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:42.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:42.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:42.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:42.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:43.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:43.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:43.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:43.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:44.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:44.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:44.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:44.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:45.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:45.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:45.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:45.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:46.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:46.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:46.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:46.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:47.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:47.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:47.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:47.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:48.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:48.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:48.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:48.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:49.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:49.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:49.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:49.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:50.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:50.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:50.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:50.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:51.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:51.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:51.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:51.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:52.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:52.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:52.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:52.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:53.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:53.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:53.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:53.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:54.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:54.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:54.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:54.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:55.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:55.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:55.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:55.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:56.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:56.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:56.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:56.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:57.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:57.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:57.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:57.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:58.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:58.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:58.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:58.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:59.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:19:59.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:19:59.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:19:59.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:00.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:00.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:00.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:00.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:01.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:01.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:01.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:01.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:02.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:02.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:02.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:02.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:03.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:03.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:03.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:03.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:04.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:04.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:04.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:04.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:05.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:05.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:05.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:05.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:06.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:06.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:06.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:06.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:07.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:07.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:07.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:07.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:08.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:08.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:08.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:08.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:09.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:09.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:09.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:09.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:10.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:10.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:10.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:10.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:11.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:11.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:11.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:11.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:12.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:12.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:12.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:12.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:13.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:13.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:13.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:14.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:14.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:14.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:15.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:15.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:15.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:15.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:15.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:16.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:16.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:16.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:16.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:16.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:17.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:17.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:17.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:17.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:18.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:18.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:18.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:18.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:19.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:19.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:19.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:19.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:20.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:20.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:20.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:20.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:21.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:21.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:22.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:22.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:22.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:22.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:22.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:22.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:23.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:23.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:23.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:23.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:24.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:24.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:24.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:24.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:25.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:25.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:26.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:26.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:26.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:26.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:26.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:26.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:27.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:27.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:27.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:27.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:28.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:28.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:28.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:28.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:29.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:29.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:29.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:29.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:30.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:30.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:30.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:30.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:31.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:31.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:32.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:32.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:32.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:32.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:33.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:33.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:33.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:33.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:34.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:34.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:34.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:34.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:35.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:35.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:35.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:35.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:36.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:36.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:36.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:36.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:37.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:37.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:37.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:37.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:38.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:38.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:38.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:38.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:39.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:39.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:39.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:39.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:40.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:40.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:40.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:40.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:41.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:41.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:41.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:41.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:42.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:42.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:42.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:42.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:43.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:43.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:43.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:43.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:44.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:44.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:44.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:44.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:45.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:45.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:45.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:45.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:46.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:46.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:46.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:46.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:47.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:47.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:47.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:47.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:48.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:48.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:48.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:48.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:49.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:49.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:49.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:49.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:50.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:50.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:50.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:50.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:51.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:51.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:51.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:51.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:52.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:52.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:52.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:52.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:52.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:53.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:53.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:53.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:53.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:53.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:54.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:54.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:54.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:54.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:55.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:55.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:55.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:55.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:56.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:56.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:56.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:56.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:57.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:57.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:57.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:57.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:58.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:58.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:58.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:58.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:59.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:20:59.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:20:59.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:20:59.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:00.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:00.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:00.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:00.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:01.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:01.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:01.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:01.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:02.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:02.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:02.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:02.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:03.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:03.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:03.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:03.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:04.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:04.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:04.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:04.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:05.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:05.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:05.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:05.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:06.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:06.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:06.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:06.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:07.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:07.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:07.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:07.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:08.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:08.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:08.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:08.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:09.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:09.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:09.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:09.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:10.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:10.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:10.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:10.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:11.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:11.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:11.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:11.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:12.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:12.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:12.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:12.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:13.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:13.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:13.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:13.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:14.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:14.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:14.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:14.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:15.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:15.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:15.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:15.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:16.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:16.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:16.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:16.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:17.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:17.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:17.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:17.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:18.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:18.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:18.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:18.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:19.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:19.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:19.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:19.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:20.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:20.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:20.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:20.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:21.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:21.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:21.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:21.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:22.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:22.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:22.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:22.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:23.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:23.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:23.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:23.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:24.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:24.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:24.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:24.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:25.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:25.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:25.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:25.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:26.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:26.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:26.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:26.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:27.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:27.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:27.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:27.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:28.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:28.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:28.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:28.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:29.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:29.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:29.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:29.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:30.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:30.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:30.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:30.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:31.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:31.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:31.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:31.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:32.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:32.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:32.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:32.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:33.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:33.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:33.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:33.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:34.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:34.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:34.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:34.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:35.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:35.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:35.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:35.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:36.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:36.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:36.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:36.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:37.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:37.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:37.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:37.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:38.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:38.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:38.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:38.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:39.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:39.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:39.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:39.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:40.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:40.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:40.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:40.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:41.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:41.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:41.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:41.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:42.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:42.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:42.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:42.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:43.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:43.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:43.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:43.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:44.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:44.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:44.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:44.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:45.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:45.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:45.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:45.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:46.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:46.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:46.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:46.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:47.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:47.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:47.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:47.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:48.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:48.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:48.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:48.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:49.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:49.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:49.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:49.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:50.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:50.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:50.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:50.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:51.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:51.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:51.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:51.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:52.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:52.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:52.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:52.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:53.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:53.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:53.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:53.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:54.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:54.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:54.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:54.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:55.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:55.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:55.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:55.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:56.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:56.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:56.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:56.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:57.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:57.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:57.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:57.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:58.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:58.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:58.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:58.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:59.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:21:59.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:21:59.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:21:59.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:00.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:00.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:00.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:00.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:01.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:01.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:01.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:01.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:02.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:02.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:02.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:02.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:03.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:03.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:03.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:03.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:04.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:04.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:04.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:04.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:05.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:05.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:05.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:05.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:06.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:06.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:06.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:06.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:07.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:07.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:07.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:07.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:08.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:08.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:08.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:08.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:09.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:09.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:09.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:09.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:10.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:10.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:11.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:11.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:11.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:11.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:11.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:12.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:12.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:12.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:13.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:13.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:13.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:13.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:13.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:14.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:14.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:14.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:14.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:14.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:15.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:15.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:15.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:15.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:16.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:16.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:17.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:17.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:17.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:17.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:18.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:18.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:18.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:18.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:19.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:19.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:19.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:19.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:19.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:19.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:20.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:20.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:20.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:20.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:21.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:21.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:21.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:21.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:22.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:22.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:22.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:23.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:23.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:23.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:23.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:24.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:24.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:24.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:25.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:25.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:25.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:25.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:26.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:26.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:26.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:26.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:26.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:27.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:27.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:27.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:28.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:28.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:28.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:28.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:29.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:29.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:29.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:29.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:30.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:30.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:30.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:30.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:31.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:31.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:31.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:31.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:32.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:32.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:32.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:32.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:33.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:33.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:33.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:33.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:34.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:34.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:34.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:34.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:35.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:35.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:35.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:35.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:36.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:36.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:36.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:36.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:37.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:37.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:37.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:37.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:38.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:38.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:38.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:38.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:39.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:39.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:39.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:39.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:40.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:40.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:40.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:40.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:41.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:41.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:41.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:41.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:42.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:42.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:42.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:42.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:43.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:43.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:43.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:43.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:44.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:44.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:44.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:44.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:45.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:45.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:45.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:45.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:46.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:46.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:46.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:46.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:47.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:47.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:47.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:47.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:48.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:48.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:48.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:48.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:49.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:49.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:49.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:49.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:50.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:50.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:50.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:50.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:51.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:51.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:51.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:51.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:52.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:52.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:52.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:52.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:53.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:53.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:53.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:53.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:54.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:54.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:54.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:54.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:55.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:55.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:55.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:55.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:56.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:56.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:56.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:56.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:57.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:57.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:57.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:57.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:58.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:58.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:58.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:58.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:59.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:22:59.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:22:59.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:22:59.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:00.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:00.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:00.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:00.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:01.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:01.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:01.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:01.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:02.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:02.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:02.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:02.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:03.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:03.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:03.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:03.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:04.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:04.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:04.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:04.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:05.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:05.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:05.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:05.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:06.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:06.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:06.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:06.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:07.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:07.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:07.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:07.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:08.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:08.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:08.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:08.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:09.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:09.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:09.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:09.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:10.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:10.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:10.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:10.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:11.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:11.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:11.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:11.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:12.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:12.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:12.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:12.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:13.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:13.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:13.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:13.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:14.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:14.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:14.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:14.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:15.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:15.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:15.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:15.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:16.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:16.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:16.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:16.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:17.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:17.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:17.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:17.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:18.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:18.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:18.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:18.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:19.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:19.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:19.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:19.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:20.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:20.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:20.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:20.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:21.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:21.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:21.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:21.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:22.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:22.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:22.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:22.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:23.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:23.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:23.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:23.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:24.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:24.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:24.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:24.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:25.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:25.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:25.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:25.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:26.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:26.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:26.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:26.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:27.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:27.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:27.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:27.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:28.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:28.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:28.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:28.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:29.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:29.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:29.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:29.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:30.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:30.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:30.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:30.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:31.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:31.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:31.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:31.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:32.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:32.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:32.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:32.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:33.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:33.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:33.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:33.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:34.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:34.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:34.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:34.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:35.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:35.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:35.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:35.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:36.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:36.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:36.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:36.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:37.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:37.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:37.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:37.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:38.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:38.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:38.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:38.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:39.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:39.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:39.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:39.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:40.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:40.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:40.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:40.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:41.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:41.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:41.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:41.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:42.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:42.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:42.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:42.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:43.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:43.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:43.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:43.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:44.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:44.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:44.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:44.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:45.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:45.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:45.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:45.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:46.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:46.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:46.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:46.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:47.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:47.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:47.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:47.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:48.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:48.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:48.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:48.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:49.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:49.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:49.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:49.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:50.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:50.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:50.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:50.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:51.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:51.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:51.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:51.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:52.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:52.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:52.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:52.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:53.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:53.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:53.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:53.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:54.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:54.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:54.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:54.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:55.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:55.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:55.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:55.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:56.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:56.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:56.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:56.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:57.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:57.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:57.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:57.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:58.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:58.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:58.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:58.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:59.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:23:59.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:23:59.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:23:59.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:00.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:00.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:00.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:00.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:01.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:01.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:01.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:01.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:02.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:02.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:02.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:02.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:03.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:03.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:03.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:03.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:04.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:04.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:04.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:04.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:05.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:05.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:05.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:05.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:06.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:06.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:06.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:06.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:07.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:07.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:07.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:07.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:08.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:08.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:08.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:08.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:09.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:09.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:09.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:09.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:10.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:10.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:10.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:10.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:11.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:11.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:11.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:11.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:12.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:12.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:12.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:12.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:13.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:13.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:13.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:13.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:14.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:14.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:14.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:14.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:15.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:15.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:15.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:15.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:16.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:16.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:16.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:16.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:17.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:17.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:17.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:17.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:18.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:18.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:18.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:18.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:19.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:19.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:19.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:19.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:20.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:20.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:20.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:20.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:21.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:21.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:21.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:21.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:22.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:22.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:22.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:22.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:23.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:23.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:23.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:23.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:24.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:24.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:24.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:24.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:25.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:25.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:25.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:25.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:26.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:26.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:26.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:26.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:27.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:27.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:27.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:27.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:28.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:28.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:28.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:28.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:29.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:29.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:29.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:29.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:30.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:30.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:30.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:30.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:31.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:31.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:31.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:31.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:32.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:32.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:32.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:32.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:33.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:33.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:33.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:33.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:34.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:34.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:34.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:34.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:35.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:35.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:35.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:35.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:36.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:36.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:36.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:36.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:37.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:37.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:37.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:37.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:38.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:38.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:38.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:38.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:39.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:39.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:39.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:39.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:40.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:40.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:40.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:40.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:41.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:41.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:41.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:41.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:42.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:42.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:42.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:42.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:43.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:43.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:43.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:43.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:44.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:44.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:44.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:44.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:45.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:45.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:45.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:45.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:46.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:46.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:46.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:46.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:47.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:47.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:47.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:47.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:48.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:48.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:48.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:48.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:49.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:49.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:49.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:49.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:50.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:50.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:50.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:50.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:51.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:51.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:51.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:51.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:52.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:52.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:52.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:52.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:53.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:53.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:53.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:53.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:54.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:54.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:54.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:54.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:55.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:55.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:55.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:55.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:56.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:56.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:56.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:56.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:57.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:57.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:57.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:57.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:58.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:58.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:58.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:58.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:59.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:24:59.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:24:59.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:24:59.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:00.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:00.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:00.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:00.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:01.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:01.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:01.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:01.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:02.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:02.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:02.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:02.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:03.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:03.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:03.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:03.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:04.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:04.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:04.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:04.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:05.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:05.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:05.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:05.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:06.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:06.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:06.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:06.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:07.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:07.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:07.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:07.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:08.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:08.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:08.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:08.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:09.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:09.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:09.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:09.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:10.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:10.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:10.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:10.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:11.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:11.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:11.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:11.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:12.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:12.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:12.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:12.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:13.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:13.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:13.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:13.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:14.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:14.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:14.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:14.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:15.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:15.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:15.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:15.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:16.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:16.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:16.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:16.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:17.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:17.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:17.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:17.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:18.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:18.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:18.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:18.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:19.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:19.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:19.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:19.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:20.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:20.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:20.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:20.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:21.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:21.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:21.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:21.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:22.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:22.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:22.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:22.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:23.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:23.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:23.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:23.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:24.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:24.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:24.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:24.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:25.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:25.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:25.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:25.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:26.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:26.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:26.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:26.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:27.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:27.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:27.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:27.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:28.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:28.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:28.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:28.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:29.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:29.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:29.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:29.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:30.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:30.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:30.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:30.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:31.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:31.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:31.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:31.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:32.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:32.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:32.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:32.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:33.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:33.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:33.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:33.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:34.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:34.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:34.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:34.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:35.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:35.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:35.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:35.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:36.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:36.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:36.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:36.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:37.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:37.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:37.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:37.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:38.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:38.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:38.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:38.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:39.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:39.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:39.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:39.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:40.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:40.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:40.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:40.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:41.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:41.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:41.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:41.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:42.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:42.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:42.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:42.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:43.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:43.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:43.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:43.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:44.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:44.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:44.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:44.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:45.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:45.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:45.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:45.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:46.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:46.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:46.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:46.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:47.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:47.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:47.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:47.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:48.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:48.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:48.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:48.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:49.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:49.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:49.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:49.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:50.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:50.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:50.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:50.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:51.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:51.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:51.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:51.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:52.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:52.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:52.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:52.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:53.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:53.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:53.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:53.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:54.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:54.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:54.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:54.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:55.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:55.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:55.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:55.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:56.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:56.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:56.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:56.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:57.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:57.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:57.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:57.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:58.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:58.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:58.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:58.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:59.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:25:59.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:25:59.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:25:59.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:00.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:00.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:00.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:00.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:01.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:01.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:01.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:01.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:02.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:02.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:02.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:02.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:03.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:03.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:03.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:03.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:04.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:04.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:04.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:04.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:04.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:04.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:05.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:05.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:05.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:06.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:06.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:06.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:07.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:07.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:07.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:07.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:08.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:08.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:08.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:08.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:08.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:09.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:09.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:09.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:10.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:10.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:10.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:10.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:10.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:10.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:11.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:11.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:11.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:11.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:12.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:12.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:12.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:12.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:13.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:13.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:13.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:13.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:14.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:14.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:14.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:15.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:15.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:15.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:16.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:16.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:16.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:16.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:16.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:16.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:17.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:17.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:17.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:17.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:18.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:18.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:18.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:18.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:19.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:19.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:20.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:20.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:20.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:20.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:20.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:21.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:21.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:21.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:21.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:21.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:22.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:22.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:22.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:23.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:23.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:23.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:23.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:23.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:24.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:24.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:24.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:24.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:25.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:25.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:25.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:25.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:26.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:26.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:26.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:26.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:27.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:27.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:27.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:27.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:28.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:28.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:28.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:29.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:29.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:29.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:30.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:30.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:30.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:30.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:31.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:31.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:31.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:31.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:32.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:32.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:32.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:32.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:32.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:33.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:33.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:33.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:34.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:34.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:34.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:34.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:35.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:35.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:35.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:35.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:36.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:36.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:36.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:36.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:37.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:37.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:37.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:37.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:38.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:38.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:38.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:38.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:39.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:39.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:39.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:39.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:40.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:40.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:40.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:40.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:41.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:41.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:41.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:41.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:42.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:42.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:42.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:42.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:43.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:43.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:43.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:43.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:43.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:43.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:44.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:44.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:45.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:45.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:45.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:45.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:46.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:46.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:46.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:46.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:47.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:47.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:47.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:47.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:47.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:47.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:48.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:48.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:49.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:49.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:49.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:49.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:50.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:50.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:50.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:50.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:51.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:51.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:51.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:51.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:52.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:52.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:52.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:52.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:53.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:53.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:53.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:53.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:54.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:54.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:54.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:54.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:55.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:55.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:55.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:55.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:56.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:56.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:56.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:56.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:57.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:57.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:57.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:57.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:58.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:58.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:58.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:58.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:59.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:26:59.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:26:59.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:26:59.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:00.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:00.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:00.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:00.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:01.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:01.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:01.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:01.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:02.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:02.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:02.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:02.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:03.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:03.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:03.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:03.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:04.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:04.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:04.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:04.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:05.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:05.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:05.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:05.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:06.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:06.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:06.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:06.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:07.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:07.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:07.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:07.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:08.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:08.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:09.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:09.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:09.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:09.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:09.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:10.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:10.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:10.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:10.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:10.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:11.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:11.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:11.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:11.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:12.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:12.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:12.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:12.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:13.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:13.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:13.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:13.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:14.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:14.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:14.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:14.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:15.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:15.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:15.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:15.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:16.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:16.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:16.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:16.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:17.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:17.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:17.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:17.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:18.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:18.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:18.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:18.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:19.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:19.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:19.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:19.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:20.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:20.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:21.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:21.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:21.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:21.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:22.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:22.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:22.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:22.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:22.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:22.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:23.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:23.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:23.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:24.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:24.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:24.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:24.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:24.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:25.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:25.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:25.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:25.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:25.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:26.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:26.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:26.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:27.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:27.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:27.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:27.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:28.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:28.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:28.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:29.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:29.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:29.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:29.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:29.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:29.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:29.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:30.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:30.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:30.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:30.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:31.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:31.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:31.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:31.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:32.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:32.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:32.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:33.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:33.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:33.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:33.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:33.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:34.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:34.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:34.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:34.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:35.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:35.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:35.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:35.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:36.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:36.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:36.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:36.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:37.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:37.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:37.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:37.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:38.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:38.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:38.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:38.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:39.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:39.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:39.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:39.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:40.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:40.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:40.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:40.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:41.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:41.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:41.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:41.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:42.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:42.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:42.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:42.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:43.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:43.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:43.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:43.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:44.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:44.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:44.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:44.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:45.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:45.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:46.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:46.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:46.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:46.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:47.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:47.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:47.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:47.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:48.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:48.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:48.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:48.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:49.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:49.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:49.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:49.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:50.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:50.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:50.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:50.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:51.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:51.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:51.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:51.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:52.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:52.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:52.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:52.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:53.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:53.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:53.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:53.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:54.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:54.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:54.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:54.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:55.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:55.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:55.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:55.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:56.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:56.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:56.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:57.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:57.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:57.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:57.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:57.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:58.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:58.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:58.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:27:58.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:27:59.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:27:59.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:00.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:00.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:00.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:00.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:01.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:01.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:01.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:01.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:02.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:02.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:02.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:02.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:03.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:03.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:03.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:03.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:04.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:04.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:04.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:04.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:05.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:05.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:05.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:05.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:06.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:06.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:06.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:06.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:07.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:07.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:07.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:07.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:08.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:08.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:08.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:08.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:09.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:09.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:09.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:09.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:10.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:10.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:10.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:10.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:11.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:11.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:11.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:11.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:12.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:12.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:12.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:12.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:13.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:13.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:13.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:13.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:14.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:14.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:14.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:14.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:15.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:15.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:15.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:15.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:16.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:16.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:16.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:16.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:17.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:17.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:17.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:17.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:18.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:18.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:18.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:18.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:19.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:19.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:19.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:19.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:20.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:20.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:20.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:20.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:21.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:21.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:21.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:21.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:21.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:22.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:22.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:22.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:22.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:23.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:23.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:23.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:24.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:24.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:24.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:24.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:25.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:25.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:25.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:25.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:26.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:26.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:26.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:26.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:26.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:27.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:27.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:27.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:28.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:28.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:28.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:28.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:28.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:28.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:29.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:29.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:29.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:29.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:30.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:30.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:30.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:30.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:31.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:31.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:32.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:32.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:32.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:32.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:33.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:33.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:33.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:33.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:34.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:34.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:34.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:34.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:35.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:35.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:35.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:35.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:36.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:36.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:36.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:36.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:37.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:37.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:37.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:37.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:38.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:38.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:38.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:38.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:39.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:39.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:39.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:39.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:40.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:40.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:40.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:40.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:41.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:41.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:41.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:41.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:42.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:42.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:42.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:42.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:43.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:43.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:43.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:43.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:44.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:44.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:44.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:44.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:45.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:45.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:45.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:45.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:46.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:46.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:46.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:46.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:47.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:47.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:47.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:47.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:48.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:48.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:48.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:48.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:49.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:49.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:49.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:49.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:50.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:50.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:50.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:50.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:51.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:51.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:51.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:51.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:52.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:52.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:52.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:52.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:53.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:53.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:53.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:53.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:54.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:54.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:54.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:54.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:55.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:55.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:55.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:55.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:56.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:56.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:56.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:56.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:57.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:57.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:57.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:57.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:58.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:58.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:58.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:58.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:59.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:28:59.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:28:59.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:28:59.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:00.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:00.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:00.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:00.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:01.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:01.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:01.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:01.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:02.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:02.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:02.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:02.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:03.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:03.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:03.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:03.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:03.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:03.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:04.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:04.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:04.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:04.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:05.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:05.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:05.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:05.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:06.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:06.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:06.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:06.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:07.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:07.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:07.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:07.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:08.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:08.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:08.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:08.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:09.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:09.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:09.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:09.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:10.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:10.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:10.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:10.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:11.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:11.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:11.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:11.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:12.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:12.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:12.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:12.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:13.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:13.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:13.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:13.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:14.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:14.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:14.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:14.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:15.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:15.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:15.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:15.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:16.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:16.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:16.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:16.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:17.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:17.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:17.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:17.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:18.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:18.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:18.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:18.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:19.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:19.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:19.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:19.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:20.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:20.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:20.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:20.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:21.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:21.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:21.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:21.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:22.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:22.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:22.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:22.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:23.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:23.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:23.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:23.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:24.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:24.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:24.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:24.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:25.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:25.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:25.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:25.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:26.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:26.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:26.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:26.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:27.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:27.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:27.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:27.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:28.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:28.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:28.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:28.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:29.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:29.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:29.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:29.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:30.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:30.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:30.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:30.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:31.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:31.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:31.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:31.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:32.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:32.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:32.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:32.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:33.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:33.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:33.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:33.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:34.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:34.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:34.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:34.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:35.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:35.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:35.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:35.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:36.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:36.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:36.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:36.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:37.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:37.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:37.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:37.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:38.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:38.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:38.552 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T18:29:38.568+0000 7f81a3fff700 -1 received signal: Terminated from timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_migration.sh (PID: 101249) UID: 1000 2023-07-22T18:29:38.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:38.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:39.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:39.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:39.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:39.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:40.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:40.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:40.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:40.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:41.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:41.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:41.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:41.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:42.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:42.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:42.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:42.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:43.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:43.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:43.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:43.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:44.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:44.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:44.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:44.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:45.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:45.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:45.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:45.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:46.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:46.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:46.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:46.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:47.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:47.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:47.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:47.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:48.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:48.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:48.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:48.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:49.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:49.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:49.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:49.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:50.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:50.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:50.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:50.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:51.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:51.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:51.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:51.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:52.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:52.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:52.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:52.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:53.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:53.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:53.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:53.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:54.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:54.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:54.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:54.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:55.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:55.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:55.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:55.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:56.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:56.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:56.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:56.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:57.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:57.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:57.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:57.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:58.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:58.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:58.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:58.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:59.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:29:59.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:29:59.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:29:59.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:00.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:00.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:00.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:00.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:01.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:01.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:01.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:01.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:02.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:02.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:02.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:02.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:03.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:03.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:03.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:03.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:04.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:04.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:04.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:04.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:05.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:05.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:05.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:05.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:06.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:06.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:06.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:07.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:07.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:07.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:08.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:08.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:08.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:08.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:08.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:09.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:09.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:09.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:09.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:09.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:10.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:10.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:10.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:10.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:11.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:11.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:11.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:11.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:12.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:12.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:13.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:13.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:13.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:13.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:13.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:13.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:14.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:14.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:14.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:15.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:15.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:15.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:15.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:15.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:16.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:16.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:16.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:16.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:17.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:17.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:17.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:17.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:18.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:18.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:18.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:19.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:19.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:19.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:20.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:20.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:20.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:20.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:21.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:21.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:21.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:21.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:22.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:22.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:22.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:22.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:23.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:23.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:23.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:23.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:24.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:24.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:24.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:24.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:25.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:25.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:25.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:25.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:26.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:26.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:26.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:26.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:27.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:27.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:27.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:27.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:28.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:28.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:28.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:28.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:29.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:29.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:29.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:29.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:30.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:30.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:30.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:30.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:31.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:31.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:31.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:31.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:32.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:32.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:32.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:32.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:33.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:33.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 39 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:33.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:33.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:34.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:34.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:34.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:34.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:35.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:35.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:35.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:35.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:36.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:36.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:36.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:36.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:37.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:37.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:37.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:37.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:38.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:38.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:38.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:38.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:39.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:39.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:39.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:39.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:40.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:40.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:40.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:40.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:41.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:41.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:41.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:41.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:42.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:42.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:42.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:43.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:43.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:43.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:43.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:44.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:44.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:44.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:44.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:45.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:45.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:45.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:46.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:46.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:46.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:46.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:47.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:47.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:47.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:47.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:48.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:48.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:48.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:48.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:49.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:49.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:49.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:49.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:50.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:50.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:50.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:50.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:51.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:51.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:51.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:51.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:52.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:52.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:52.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:52.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:53.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:53.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:53.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:53.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:54.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:54.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:54.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:54.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:55.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:55.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:55.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:55.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:56.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:56.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:56.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:56.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:57.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:57.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:57.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:57.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:58.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:58.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:58.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:58.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:59.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:59.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:59.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:30:59.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:30:59.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:30:59.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:00.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:00.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:00.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:01.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:01.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:01.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:01.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:01.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:02.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:02.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:02.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:02.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:03.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:03.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 26 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:03.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:03.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:04.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:04.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:04.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:05.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:05.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:05.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:06.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:06.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:06.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:06.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:07.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:07.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:07.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:07.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:08.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:08.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:08.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:08.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:09.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:09.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:09.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:09.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:10.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:10.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:10.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:10.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:11.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:11.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:11.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:11.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:12.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:12.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:12.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:12.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:13.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:13.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:13.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:13.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:14.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:14.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:14.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:14.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:15.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:15.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:15.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:15.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:16.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:16.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:16.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:16.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:17.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:17.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:17.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:17.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:18.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:18.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:18.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:18.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:19.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:19.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:19.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:19.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:19.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:19.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:20.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:20.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:20.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:20.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:21.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:21.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:21.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:21.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:22.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:22.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:22.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:22.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:23.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:23.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:23.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:23.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:24.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:24.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:24.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:24.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:25.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:25.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:25.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:25.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:26.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:26.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:26.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:26.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:27.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:27.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:27.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:27.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:28.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:28.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:28.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:28.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:29.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:29.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:29.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:29.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:30.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:30.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:30.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:30.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:31.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:31.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:31.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:31.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:32.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:32.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:32.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:32.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:33.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:33.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:33.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:34.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:34.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:34.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:34.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:35.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:35.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:35.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:36.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:36.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:36.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:36.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:37.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:37.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:37.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:37.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:38.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:38.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:38.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:38.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:38.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:38.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:39.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:39.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:39.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:40.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:40.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:40.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:41.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:41.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:41.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:41.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:41.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:41.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:42.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:42.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:42.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:42.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:43.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:43.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:43.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:43.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:44.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:44.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:44.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:44.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:45.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:45.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:45.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:45.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:46.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:46.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:46.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:46.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:47.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:47.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:47.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:47.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:48.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:48.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:48.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:49.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:49.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:49.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:50.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:50.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:50.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:50.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:51.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:51.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:51.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:51.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:52.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:52.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:52.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:52.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:53.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:53.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:53.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:53.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:54.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:54.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:54.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:54.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:55.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:55.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:55.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:55.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:56.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:56.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:56.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:56.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:57.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:57.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:57.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:57.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:58.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:58.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:58.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:58.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:59.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:31:59.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:31:59.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:31:59.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:00.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:00.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:00.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:00.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:01.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:01.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:01.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:01.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:02.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:02.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:02.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:02.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:03.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:03.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:03.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:03.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:04.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:04.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:04.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:04.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:05.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:05.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:05.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:05.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:06.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:06.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:06.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:06.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:07.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:07.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:07.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:07.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:08.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:08.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:08.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:08.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:08.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:09.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:09.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:09.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:09.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:09.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:10.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:10.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:10.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:10.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:11.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:11.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:11.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:11.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:12.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:12.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:12.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:12.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:13.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:13.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:13.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:13.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:14.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:14.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:14.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:14.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:15.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:15.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:15.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:15.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:16.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:16.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:16.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:16.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:17.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:17.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:17.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:17.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:18.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:18.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:18.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:18.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:19.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:19.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:19.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:19.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:20.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:20.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:20.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:20.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:21.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:21.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:21.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:21.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:22.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:22.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:22.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:22.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:23.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:23.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:23.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:23.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:24.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:24.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:24.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:24.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:25.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:25.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:25.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:25.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:26.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:26.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:26.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:26.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:27.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:27.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:27.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:27.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:28.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:28.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:28.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:28.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:29.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:29.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:29.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:29.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:30.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:30.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:30.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:30.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:31.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:31.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:31.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:31.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:32.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:32.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:32.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:32.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:33.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:33.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:33.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:33.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:34.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:34.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:34.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:34.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:35.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:35.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:35.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:35.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:36.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:36.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:36.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:36.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:37.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:37.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:37.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:37.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:38.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:38.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:38.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:38.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:39.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:39.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:39.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:39.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:40.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:40.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:40.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:40.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:41.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:41.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:41.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:41.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:42.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:42.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:42.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:42.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:43.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:43.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:43.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:43.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:44.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:44.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:44.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:44.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:45.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:45.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:45.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:45.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:46.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:46.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:46.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:46.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:47.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:47.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:47.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:47.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:48.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:48.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:48.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:48.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:49.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:49.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:49.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:49.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:50.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:50.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:50.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:50.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:51.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:51.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:51.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:51.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:52.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:52.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:52.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:52.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:53.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:53.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:53.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:53.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:54.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:54.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:54.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:54.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:55.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:55.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:55.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:55.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:56.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:56.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:56.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:56.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:57.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:57.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:57.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:57.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:58.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:58.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:58.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:58.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:59.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:32:59.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:32:59.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:32:59.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:00.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:00.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:00.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:00.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:01.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:01.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:01.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:01.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:02.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:02.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:02.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:02.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:03.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:03.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:03.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:03.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:04.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:04.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:04.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:04.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:05.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:05.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:05.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:05.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:06.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:06.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:06.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:06.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:07.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:07.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:07.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:07.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:08.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:08.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:08.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:08.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:09.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:09.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:09.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:09.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:10.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:10.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:10.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:10.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:11.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:11.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:11.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:11.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:12.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:12.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:12.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:12.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:13.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:13.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:13.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:13.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:14.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:14.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:14.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:14.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:15.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:15.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:15.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:15.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:16.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:16.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:16.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:16.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:17.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:17.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:17.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:17.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:18.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:18.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:18.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:18.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:19.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:19.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:19.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:19.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:20.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:20.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:20.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:20.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:21.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:21.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:21.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:21.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:22.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:22.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:22.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:22.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:23.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:23.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:23.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:23.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:24.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:24.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:24.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:24.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:25.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:25.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:25.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:25.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:26.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:26.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:26.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:26.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:27.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:27.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:27.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:27.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:28.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:28.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:28.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:28.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:29.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:29.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:29.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:29.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:30.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:30.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:30.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:30.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:31.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:31.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:31.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:31.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:32.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:32.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:32.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:32.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:33.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:33.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:33.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:33.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:34.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:34.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:34.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:34.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:35.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:35.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:35.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:35.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:36.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:36.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:36.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:36.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:37.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:37.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:37.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:37.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:38.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:38.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:38.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:38.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:39.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:39.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:39.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:39.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:40.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:40.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:40.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:40.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:41.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:41.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:41.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:41.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:42.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:42.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:42.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:42.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:43.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:43.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:43.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:43.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:44.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:44.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:44.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:44.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:45.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:45.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:45.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:45.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:46.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:46.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:46.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:46.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:47.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:47.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:47.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:47.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:48.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:48.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:48.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:48.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:49.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:49.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:49.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:49.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:50.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:50.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:50.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:50.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:51.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:51.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:51.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:51.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:52.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:52.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:52.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:52.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:53.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:53.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:53.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:53.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:54.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:54.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:54.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:54.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:55.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:55.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:55.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:55.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:56.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:56.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:56.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:56.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:57.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:57.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:57.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:57.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:58.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:58.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:58.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:58.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:59.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:33:59.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:33:59.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:33:59.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:00.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:00.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:00.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:00.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:01.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:01.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:01.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:01.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:02.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:02.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:02.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:02.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:03.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:03.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:03.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:03.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:04.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:04.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:04.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:04.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:05.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:05.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:05.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:05.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:06.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:06.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:06.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:06.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:07.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:07.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:07.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:07.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:08.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:08.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:08.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:08.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:09.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:09.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:09.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:09.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:10.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:10.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:10.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:10.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:11.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:11.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:11.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:11.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:12.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:12.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:12.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:12.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:13.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:13.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:13.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:13.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:14.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:14.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:14.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:14.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:15.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:15.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:15.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:15.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:16.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:16.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:16.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:16.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:17.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:17.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:17.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:17.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:18.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:18.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:18.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:18.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:19.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:19.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:19.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:19.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:20.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:20.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:20.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:20.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:21.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:21.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:21.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:21.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:22.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:22.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:22.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:22.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:23.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:23.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:23.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:23.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:24.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:24.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:24.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:24.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:25.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:25.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:25.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:25.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:26.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:26.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:26.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:26.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:27.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:27.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:27.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:27.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:28.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:28.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:28.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:28.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:29.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:29.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:29.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:29.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:30.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:30.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:30.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:30.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:31.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:31.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:31.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:31.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:32.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:32.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:32.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:32.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:33.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:33.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:33.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:33.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:34.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:34.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:34.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:34.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:35.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:35.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:35.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:35.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:36.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:36.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:36.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:36.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:37.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:37.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:37.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:37.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:38.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:38.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:38.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:38.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:39.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:39.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:39.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:39.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:40.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:40.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:40.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:40.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:41.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:41.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:41.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:41.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:42.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:42.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:42.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:42.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:43.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:43.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:43.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:43.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:44.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:44.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:44.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:44.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:45.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:45.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:45.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:45.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:46.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:46.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:46.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:46.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:47.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:47.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:47.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:47.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:48.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:48.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:48.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:48.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:49.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:49.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:49.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:49.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:50.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:50.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:50.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:50.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:51.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:51.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:51.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:51.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:52.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:52.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:52.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:52.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:53.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:53.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:53.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:53.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:54.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:54.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:54.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:54.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:55.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:55.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:55.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:55.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:56.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:56.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:56.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:56.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:57.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:57.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:57.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:57.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:58.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:58.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:58.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:58.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:59.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:34:59.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:34:59.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:34:59.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:00.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:00.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:00.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:00.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:01.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:01.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:01.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:01.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:02.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:02.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:02.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:02.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:03.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:03.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:03.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:03.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:04.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:04.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:04.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:04.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:05.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:05.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:05.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:05.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:06.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:06.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:06.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:06.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:07.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:07.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:07.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:07.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:08.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:08.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:08.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:08.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:09.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:09.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:09.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:09.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:10.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:10.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:10.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:10.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:11.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:11.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:11.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:11.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:12.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:12.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:12.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:12.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:13.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:13.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:13.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:13.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:14.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:14.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:14.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:14.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:15.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:15.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:15.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:15.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:16.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:16.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:16.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:16.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:17.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:17.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:17.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:17.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:18.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:18.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:18.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:18.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:19.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:19.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:19.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:19.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:20.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:20.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:20.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:21.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:21.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:21.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:21.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:21.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:22.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:22.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:22.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:22.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:23.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:23.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:24.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:24.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:24.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:24.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:24.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:25.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:25.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:25.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:26.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:26.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:26.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:26.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:27.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:27.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:27.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:27.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:28.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:28.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:28.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:28.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:29.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:29.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:29.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:29.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:30.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:30.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:30.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:30.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:31.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:31.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:31.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:31.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:32.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:32.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:32.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:32.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:33.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:33.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:33.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:33.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:33.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:34.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:34.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:34.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:34.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:34.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:35.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:35.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:35.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:35.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:36.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:36.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:36.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:36.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:37.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:37.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:37.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:37.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:38.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:38.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:38.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:38.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:39.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:39.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:39.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:39.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:40.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:40.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:40.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:40.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:41.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:41.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:41.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:41.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:42.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:42.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:42.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:43.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:43.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:43.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:44.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:44.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:44.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:44.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:45.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:45.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:45.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:45.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:46.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:46.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:46.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:46.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:47.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:47.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:47.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:47.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:48.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:48.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:48.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:48.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:49.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:49.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:49.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:49.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:50.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:50.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:50.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:50.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:51.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:51.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:51.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:51.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:52.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:52.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:52.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:52.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:53.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:53.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:53.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:53.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:54.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:54.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:54.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:54.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:55.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:55.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:55.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:55.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:56.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:56.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:56.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:57.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:57.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:57.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:57.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:57.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:58.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:58.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:59.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:59.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:59.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:35:59.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:35:59.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:35:59.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:00.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:00.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:00.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:00.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:01.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:01.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:01.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:01.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:02.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:02.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:02.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:02.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:03.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:03.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:03.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:03.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:04.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:04.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:04.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:04.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:05.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:05.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:05.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:05.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:06.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:06.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:06.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:06.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:07.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:07.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:07.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:07.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:08.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:08.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:08.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:08.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:09.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:09.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:09.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:09.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:10.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:10.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:10.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:10.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:11.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:11.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:11.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:11.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:12.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:12.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:12.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:12.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:13.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:13.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:13.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:13.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:14.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:14.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:14.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:14.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:15.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:15.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:15.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:15.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:16.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:16.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:16.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:16.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:17.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:17.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:17.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:17.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:18.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:18.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:18.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:18.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:19.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:19.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:19.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:19.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:20.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:20.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:20.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:20.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:21.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:21.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:21.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:21.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:22.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:22.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:22.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:22.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:23.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:23.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:23.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:23.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:24.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:24.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:24.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:24.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:25.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:25.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:25.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:25.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:26.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:26.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:26.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:26.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:27.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:27.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:27.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:27.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:28.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:28.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:28.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:28.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:29.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:29.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:29.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:29.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:30.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:30.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:30.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:30.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:31.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:31.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:31.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:31.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:32.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:32.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:32.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:32.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:33.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:33.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:33.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:33.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:34.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:34.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:34.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:34.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:35.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:35.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:35.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:35.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:36.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:36.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:36.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:36.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:37.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:37.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:37.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:37.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:38.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:38.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:38.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:38.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:39.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:39.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:39.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:39.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:40.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:40.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:40.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:40.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:41.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:41.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:41.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:41.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:42.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:42.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:42.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:42.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:43.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:43.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:43.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:43.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:44.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:44.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:44.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:44.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:45.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:45.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:45.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:45.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:46.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:46.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:46.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:46.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:47.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:47.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:47.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:47.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:48.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:48.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:48.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:48.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:49.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:49.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:49.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:49.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:50.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:50.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:50.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:50.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:51.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:51.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:51.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:51.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:52.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:52.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:52.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:52.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:53.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:53.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:53.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:53.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:54.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:54.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:54.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:54.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:55.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:55.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:55.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:55.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:56.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:56.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:56.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:56.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:57.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:57.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:57.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:57.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:58.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:58.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:58.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:58.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:59.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:36:59.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:36:59.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:36:59.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:00.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:00.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:00.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:00.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:01.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:01.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:01.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:01.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:02.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:02.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:02.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:02.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:03.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:03.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:03.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:03.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:04.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:04.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:04.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:04.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:05.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:05.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:05.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:05.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:06.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:06.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:06.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:06.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:07.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:07.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:07.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:07.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:08.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:08.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:08.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:08.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:09.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:09.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:09.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:09.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:10.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:10.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:10.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:10.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:11.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:11.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:11.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:11.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:12.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:12.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:12.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:12.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:13.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:13.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:13.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:13.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:14.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:14.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:14.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:14.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:15.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:15.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:15.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:15.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:16.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:16.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:16.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:16.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:17.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:17.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:17.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:17.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:18.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:18.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:18.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:18.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:19.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:19.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:19.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:19.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:20.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:20.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:20.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:20.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:21.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:21.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:21.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:21.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:22.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:22.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:22.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:22.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:23.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:23.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:23.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:23.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:24.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:24.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:24.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:24.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:25.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:25.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:25.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:25.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:26.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:26.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:26.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:26.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:27.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:27.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:27.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:27.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:28.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:28.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:28.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:28.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:29.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:29.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:29.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:29.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:30.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:30.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:30.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:30.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:31.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:31.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:31.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:31.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:32.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:32.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:32.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:32.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:33.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:33.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:33.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:33.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:34.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:34.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:34.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:34.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:35.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:35.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:35.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:35.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:36.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:36.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:36.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:36.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:37.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:37.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:37.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:37.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:38.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:38.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:38.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:38.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:39.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:39.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:39.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:39.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:40.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:40.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:40.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:40.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:41.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:41.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:41.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:41.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:42.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:42.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:42.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:42.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:43.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:43.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:43.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:43.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:44.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:44.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:44.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:44.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:45.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:45.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:45.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:45.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:46.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:46.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:46.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:46.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:47.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:47.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:47.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:47.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:48.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:48.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:48.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:48.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:49.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:49.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:49.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:49.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:50.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:50.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:50.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:50.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:51.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:51.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:51.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:51.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:52.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:52.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:52.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:52.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:53.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:53.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:53.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:53.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:54.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:54.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:54.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:54.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:55.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:55.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:55.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:55.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:56.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:56.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:56.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:56.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:57.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:57.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:57.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:57.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:58.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:58.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:58.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:37:58.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:59.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:37:59.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:37:59.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:00.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:00.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:00.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:00.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:00.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:01.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:01.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:01.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:01.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:02.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:02.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:02.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:02.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:03.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:03.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:03.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:03.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:04.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:04.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:04.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:04.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:05.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:05.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:05.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:05.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:06.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:06.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:06.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:06.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:07.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:07.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:07.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:07.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:08.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:08.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:08.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:08.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:09.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:09.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:09.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:09.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:10.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:10.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:10.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:10.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:11.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:11.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:11.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:11.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:12.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:12.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:12.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:12.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:13.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:13.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:13.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:13.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:14.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:14.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:14.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:14.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:15.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:15.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:15.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:15.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:16.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:16.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:16.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:16.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:17.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:17.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:17.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:17.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:18.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:18.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:18.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:18.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:19.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:19.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:19.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:19.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:20.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:20.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:20.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:20.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:21.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:21.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:21.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:21.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:22.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:22.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:22.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:22.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:23.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:23.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:23.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:23.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:24.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:24.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:24.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:24.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:25.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:25.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:25.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:25.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:26.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:26.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:26.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:26.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:27.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:27.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:27.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:27.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:28.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:28.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:28.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:28.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:29.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:29.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:29.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:29.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:30.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:30.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:30.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:30.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:31.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:31.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:31.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:31.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:32.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:32.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:32.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:32.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:33.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:33.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:33.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:33.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:34.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:34.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:34.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:34.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:35.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:35.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:35.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:35.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:36.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:36.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:36.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:36.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:37.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:37.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:37.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:37.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:38.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:38.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:38.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:38.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:39.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:39.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:39.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:39.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:40.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:40.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:40.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:40.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:41.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:41.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:41.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:41.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:42.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:42.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:42.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:42.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:43.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:43.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:43.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:43.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:44.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:44.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:44.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:44.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:45.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:45.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:45.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:45.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:46.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:46.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:46.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:46.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:47.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:47.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:47.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:47.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:48.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:48.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:48.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:48.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:49.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:49.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:49.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:50.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:50.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:50.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:50.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:51.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:51.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:51.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:51.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:51.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:52.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:52.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:52.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:52.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:53.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:53.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:53.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:53.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:54.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:54.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:54.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:54.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:55.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:55.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:55.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:55.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:56.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:56.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:56.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:56.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:57.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:57.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:57.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:57.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:58.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:58.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:58.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:58.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:59.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:38:59.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:38:59.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:38:59.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:00.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:00.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:00.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:00.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:01.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:01.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:01.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:01.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:02.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:02.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:02.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:02.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:03.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:03.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:03.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:03.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:04.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:04.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:04.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:04.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:05.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:05.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:05.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:05.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:06.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:06.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:06.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:06.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:07.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:07.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:07.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:07.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:08.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:08.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:08.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:08.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:09.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:09.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:09.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:09.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:10.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:10.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:10.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:10.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:11.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:11.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:11.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:11.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:12.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:12.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:12.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:12.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:13.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:13.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:13.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:13.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:14.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:14.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:14.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:14.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:15.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:15.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:15.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:15.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:16.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:16.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:16.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:16.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:17.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:17.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:17.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:17.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:18.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:18.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:18.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:18.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:19.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:19.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:19.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:19.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:20.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:20.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:20.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:20.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:21.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:21.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:21.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:21.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:22.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:22.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:22.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:22.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:23.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:23.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:23.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:23.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:24.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:24.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:24.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:24.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:25.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:25.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:25.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:25.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:26.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:26.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:26.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:26.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:27.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:27.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:27.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:27.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:28.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:28.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:28.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:28.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:29.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:29.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:29.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:29.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:30.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:30.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:30.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:30.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:31.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:31.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:31.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:31.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:32.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:32.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:32.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:32.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:33.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:33.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:33.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:33.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:34.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:34.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:34.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:34.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:35.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:35.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:35.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:35.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:36.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:36.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:36.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:36.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:37.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:37.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:37.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:37.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:38.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:38.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:38.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:38.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:39.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:39.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:39.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:39.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:40.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:40.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:40.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:40.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:41.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:41.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:41.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:41.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:42.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:42.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:42.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:42.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:43.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:43.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:43.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:43.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:44.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:44.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:44.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:44.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:45.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:45.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:45.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:45.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:46.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:46.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:46.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:46.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:47.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:47.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:47.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:47.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:48.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:48.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:48.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:48.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:49.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:49.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:49.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:49.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:50.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:50.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:50.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:50.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:51.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:51.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:51.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:51.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:52.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:52.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:52.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:52.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:53.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:53.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:53.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:53.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:54.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:54.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:54.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:54.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:55.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:55.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:55.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:55.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:56.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:56.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:56.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:56.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:57.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:57.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:57.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:57.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:58.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:58.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:58.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:58.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:59.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:39:59.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:39:59.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:39:59.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:00.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:00.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:00.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:00.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:01.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:01.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:01.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:01.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:02.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:02.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:02.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:02.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:03.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:03.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:03.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:03.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:04.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:04.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:04.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:04.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:05.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:05.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:05.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:05.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:06.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:06.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:06.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:06.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:07.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:07.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:07.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:07.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:08.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:08.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:08.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:08.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:09.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:09.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:09.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:09.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:10.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:10.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:10.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:10.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:11.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:11.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:11.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:11.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:12.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:12.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:12.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:12.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:13.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:13.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:13.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:13.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:14.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:14.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:14.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:14.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:15.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:15.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:15.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:15.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:16.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:16.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:16.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:16.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:17.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:17.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:17.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:17.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:18.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:18.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:18.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:18.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:19.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:19.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:19.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:19.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:20.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:20.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:20.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:20.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:21.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:21.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:21.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:21.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:22.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:22.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:22.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:22.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:23.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:23.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:23.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:23.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:24.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:24.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:24.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:24.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:25.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:25.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:25.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:25.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:26.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:26.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:26.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:26.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:27.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:27.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:27.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:27.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:28.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:28.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:28.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:28.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:29.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:29.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:29.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:29.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:30.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:30.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:30.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:30.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:31.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:31.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:31.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:31.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:32.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:32.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:32.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:32.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:33.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:33.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:33.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:33.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:34.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:34.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:34.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:34.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:35.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:35.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:35.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:35.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:36.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:36.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:36.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:36.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:37.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:37.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:37.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:37.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:38.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:38.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:38.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:38.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:39.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:39.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:39.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:39.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:40.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:40.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:40.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:40.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:41.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:41.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:41.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:41.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:42.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:42.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:42.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:42.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:43.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:43.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:43.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:43.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:44.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:44.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:44.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:44.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:45.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:45.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:45.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:45.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:46.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:46.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:46.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:46.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:47.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:47.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:47.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:47.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:48.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:48.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:48.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:48.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:49.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:49.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:49.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:49.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:50.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:50.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:50.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:50.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:51.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:51.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:51.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:51.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:52.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:52.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:52.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:52.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:53.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:53.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:53.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:53.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:54.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:54.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:54.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:54.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:55.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:55.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:55.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:55.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:56.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:56.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:56.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:56.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:57.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:57.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:57.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:57.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:58.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:58.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:58.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:58.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:59.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:40:59.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:40:59.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:40:59.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:00.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:00.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:00.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:00.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:01.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:01.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:01.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:01.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:02.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:02.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:02.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:02.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:03.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:03.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:03.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:03.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:04.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:04.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:04.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:04.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:05.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:05.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:05.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:06.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:06.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:06.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:06.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:06.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:07.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:07.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:07.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:08.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:08.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:08.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:09.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:09.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:09.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:09.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:09.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:09.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:10.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:10.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:10.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:10.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:11.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:11.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:11.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:11.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:12.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:12.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:12.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:12.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:13.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:13.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:13.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:13.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:14.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:14.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:14.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:15.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:15.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:15.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:16.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:16.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:16.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:16.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:16.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:17.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:17.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:17.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:17.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:17.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:18.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:18.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:18.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:18.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:19.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:19.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:19.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:19.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:20.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:20.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:20.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:20.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:21.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:21.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:21.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:21.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:22.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:22.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:22.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:22.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:23.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:23.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:23.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:23.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:24.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:24.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:24.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:24.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:25.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:25.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:25.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:26.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:26.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:26.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:26.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:27.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:27.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:27.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:28.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:28.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:28.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:28.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:29.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:29.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:29.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:29.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:30.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:30.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:30.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:30.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:31.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:31.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:31.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:31.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:32.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:32.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:32.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:32.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:33.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:33.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:33.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:33.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:34.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:34.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:34.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:34.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:35.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:35.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:35.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:35.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:36.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:36.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:36.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:36.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:37.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:37.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:37.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:37.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:38.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:38.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:38.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:38.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:39.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:39.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:39.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:39.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:40.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:40.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:40.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:40.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:41.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:41.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:41.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:41.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:42.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:42.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:42.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:42.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:42.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:42.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:43.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:43.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:44.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:44.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:44.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:44.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:44.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:44.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:45.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:45.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:45.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:46.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:46.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:46.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:46.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:46.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:47.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:47.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:47.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:48.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:48.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:48.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:49.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:49.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:49.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:49.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:50.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:50.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:50.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:50.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:51.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:51.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:51.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:51.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:52.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:52.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:52.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:52.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:53.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:53.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:53.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:53.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:54.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:54.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:54.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:54.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:55.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:55.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:55.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:55.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:56.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:56.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:56.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:56.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:57.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:57.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:57.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:57.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:58.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:58.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:58.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:58.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:59.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:41:59.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:41:59.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:41:59.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:00.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:00.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:00.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:00.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:01.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:01.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:01.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:01.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:02.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:02.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:02.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:02.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:03.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:03.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:03.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:03.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:04.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:04.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:04.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:04.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:05.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:05.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:05.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:05.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:06.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:06.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:06.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:06.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:07.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:07.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:07.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:07.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:08.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:08.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:08.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:08.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:09.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:09.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:09.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:09.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:10.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:10.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:10.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:10.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:11.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:11.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:11.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:11.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:12.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:12.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:12.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:12.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:13.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:13.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:13.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:13.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:14.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:14.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:14.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:14.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:15.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:15.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:15.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:15.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:16.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:16.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:16.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:16.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:17.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:17.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:17.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:17.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:18.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:18.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:18.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:18.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:19.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:19.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:19.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:19.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:20.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:20.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:20.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:20.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:21.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:21.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:21.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:21.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:22.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:22.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:22.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:22.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:23.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:23.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:23.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:23.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:24.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:24.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:24.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:24.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:25.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:25.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:25.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:25.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:26.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:26.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:26.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:26.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:27.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:27.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:27.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:27.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:28.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:28.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:28.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:28.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:29.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:29.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:29.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:29.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:30.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:30.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:30.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:30.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:31.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:31.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:31.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:31.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:32.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:32.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:32.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:32.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:33.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:33.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:33.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:33.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:34.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:34.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:34.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:34.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:35.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:35.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:35.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:35.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:36.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:36.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:36.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:36.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:37.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:37.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:37.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:37.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:38.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:38.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:38.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:38.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:39.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:39.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:39.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:39.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:40.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:40.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:40.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:40.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:41.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:41.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:41.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:41.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:42.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:42.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:42.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:42.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:43.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:43.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:43.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:43.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:44.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:44.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:44.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:44.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:45.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:45.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:45.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:45.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:46.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:46.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:46.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:46.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:47.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:47.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:47.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:47.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:48.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:48.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:48.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:48.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:49.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:49.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:49.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:49.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:50.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:50.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:50.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:50.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:51.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:51.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:51.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:51.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:52.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:52.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:52.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:52.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:53.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:53.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:53.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:53.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:54.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:54.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:54.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:54.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:55.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:55.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:55.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:55.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:56.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:56.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:56.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:56.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:57.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:57.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:57.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:57.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:58.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:58.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:58.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:58.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:59.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:42:59.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:42:59.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:42:59.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:00.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:00.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:00.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:00.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:01.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:01.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:01.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:01.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:02.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:02.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:02.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:02.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:03.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:03.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:03.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:03.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:04.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:04.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:04.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:04.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:05.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:05.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:05.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:05.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:06.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:06.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:06.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:06.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:07.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:07.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:07.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:07.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:08.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:08.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:08.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:08.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:09.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:09.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:09.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:09.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:10.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:10.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:10.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:10.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:11.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:11.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:11.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:11.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:12.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:12.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:12.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:12.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:13.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:13.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:13.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:13.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:14.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:14.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:14.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:14.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:15.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:15.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:15.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:15.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:16.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:16.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:16.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:16.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:17.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:17.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:17.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:17.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:18.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:18.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:18.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:18.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:19.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:19.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:19.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:19.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:20.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:20.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:20.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:20.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:21.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:21.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:21.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:21.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:22.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:22.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:22.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:22.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:23.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:23.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:23.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:23.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:24.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:24.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:24.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:24.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:25.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:25.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:25.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:25.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:26.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:26.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:26.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:26.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:27.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:27.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:27.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:27.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:28.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:28.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:28.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:28.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:29.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:29.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:29.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:29.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:30.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:30.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:30.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:30.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:31.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:31.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:31.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:31.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:32.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:32.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:32.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:32.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:33.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:33.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:33.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:33.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:34.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:34.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:34.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:34.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:35.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:35.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:35.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:35.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:36.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:36.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:36.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:36.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:37.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:37.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:37.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:37.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:38.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:38.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:38.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:38.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:39.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:39.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:39.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:39.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:40.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:40.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:40.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:40.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:41.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:41.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:41.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:41.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:42.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:42.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:42.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:42.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:43.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:43.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:43.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:43.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:44.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:44.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:44.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:44.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:45.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:45.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:45.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:45.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:46.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:46.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:46.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:46.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:47.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:47.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:47.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:47.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:48.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:48.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:48.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:48.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:49.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:49.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:49.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:49.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:50.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:50.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:50.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:50.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:51.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:51.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:51.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:51.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:52.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:52.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:52.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:52.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:53.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:53.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:53.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:53.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:54.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:54.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:54.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:54.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:55.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:55.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:55.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:55.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:56.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:56.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:56.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:56.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:57.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:57.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:57.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:57.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:58.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:58.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:58.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:58.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:59.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:43:59.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:43:59.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:43:59.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:00.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:00.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:00.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:00.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:01.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:01.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:01.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:01.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:02.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:02.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:02.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:02.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:03.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:03.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:03.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:03.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:04.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:04.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:04.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:04.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:05.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:05.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:05.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:05.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:06.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:06.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:06.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:06.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:07.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:07.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:07.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:07.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:08.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:08.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:08.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:08.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:09.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:09.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:09.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:09.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:10.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:10.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:10.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:10.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:11.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:11.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:11.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:11.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:12.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:12.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:12.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:12.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:13.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:13.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:13.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:13.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:14.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:14.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:14.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:14.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:15.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:15.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:15.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:15.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:16.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:16.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:16.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:16.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:17.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:17.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:17.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:17.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:18.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:18.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:18.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:18.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:19.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:19.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:19.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:19.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:20.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:20.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:20.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:20.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:21.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:21.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:21.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:21.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:22.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:22.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:22.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:22.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:23.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:23.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:23.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:23.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:24.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:24.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:24.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:24.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:24.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:24.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:25.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:25.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:25.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:26.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:26.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:26.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:27.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:27.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:27.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:27.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:28.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:28.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:28.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:28.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:29.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:29.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:29.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:29.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:30.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:30.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:30.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:30.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:31.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:31.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:31.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:31.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:32.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:32.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:32.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:32.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:33.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:33.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:33.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:33.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:34.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:34.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:34.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:34.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:35.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:35.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:35.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:35.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:36.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:36.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:36.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:36.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:37.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:37.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:37.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:37.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:38.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:38.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:38.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:38.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:39.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:39.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:39.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:39.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:40.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:40.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:40.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:40.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:41.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:41.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:41.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:41.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:42.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:42.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:42.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:42.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:43.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:43.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:43.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:43.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:44.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:44.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:44.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:44.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:45.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:45.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:45.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:45.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:46.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:46.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:46.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:46.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:47.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:47.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:47.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:47.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:48.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:48.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:48.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:48.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:49.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:49.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:49.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:49.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:50.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:50.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:50.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:50.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:51.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:51.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:51.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:51.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:52.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:52.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:52.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:52.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:53.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:53.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:53.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:53.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:54.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:54.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:54.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:54.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:55.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:55.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:55.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:55.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:56.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:56.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:56.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:56.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:57.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:57.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:57.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:57.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:58.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:58.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:58.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:58.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:59.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:44:59.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:44:59.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:44:59.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:00.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:00.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:00.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:00.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:01.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:01.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:01.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:01.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:02.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:02.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:02.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:02.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:03.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:03.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:03.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:03.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:04.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:04.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:04.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:04.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:05.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:05.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:05.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:05.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:06.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:06.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:06.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:06.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:07.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:07.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:07.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:07.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:08.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:08.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:08.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:08.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:09.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:09.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:09.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:09.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:10.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:10.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:10.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:10.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:11.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:11.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:11.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:11.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:12.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:12.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:12.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:12.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:13.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:13.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:13.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:13.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:14.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:14.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:14.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:14.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:15.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:15.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:15.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:15.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:16.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:16.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:16.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:16.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:17.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:17.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:17.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:17.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:18.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:18.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:18.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:18.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:19.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:19.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:19.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:19.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:20.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:20.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:20.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:20.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:21.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:21.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:21.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:21.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:22.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:22.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:22.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:22.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:23.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:23.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:23.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:23.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:24.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:24.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:24.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:24.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:25.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:25.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:25.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:25.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:26.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:26.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:26.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:26.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:27.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:27.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:27.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:27.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:28.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:28.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:28.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:28.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:29.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:29.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:29.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:29.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:30.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:30.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:30.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:30.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:31.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:31.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:31.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:31.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:32.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:32.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:32.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:32.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:33.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:33.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:33.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:33.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:34.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:34.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:34.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:34.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:35.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:35.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:35.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:35.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:36.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:36.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:36.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:36.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:37.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:37.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:37.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:37.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:38.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:38.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:38.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:38.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:39.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:39.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:39.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:39.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:40.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:40.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:40.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:40.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:41.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:41.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:41.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:41.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:42.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:42.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:42.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:42.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:43.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:43.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:43.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:43.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:44.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:44.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:44.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:44.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:45.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:45.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:45.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:45.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:46.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:46.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:46.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:46.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:47.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:47.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:47.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:47.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:48.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:48.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:48.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:48.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:48.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:49.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:49.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:49.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:49.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:49.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:50.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:50.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:50.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:51.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:51.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:51.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:51.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:51.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:52.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:52.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:52.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:52.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:53.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:53.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:53.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:53.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:54.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:54.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:54.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:54.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:55.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:55.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:55.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:55.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:56.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:56.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:56.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:57.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:57.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:57.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:58.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:58.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:58.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:58.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:45:59.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:45:59.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:45:59.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:45:59.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:46:00.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:00.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:00.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:00.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:46:01.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:01.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:01.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:01.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:46:01.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:02.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:02.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:02.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 8 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T18:46:03.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:03.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:03.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:03.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:04.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:04.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:04.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:04.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:05.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:05.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:05.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:05.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:06.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:06.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:06.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:06.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:07.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:07.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:07.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:07.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:08.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:08.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:08.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:08.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:09.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:09.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:09.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:09.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:10.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:10.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:10.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:10.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:11.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:11.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:11.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:11.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:12.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:12.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:12.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:12.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:13.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:13.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:13.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:13.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:14.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:14.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:14.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:14.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:15.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:15.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:15.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:15.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:16.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:16.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:16.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:16.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:17.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:17.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:17.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:17.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:18.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:18.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:18.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:18.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:19.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:19.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:19.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:19.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:20.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:20.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:20.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:20.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:21.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:21.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:21.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:21.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:22.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:22.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:22.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:22.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:23.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:23.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:23.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:23.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:24.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:24.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:24.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:24.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:25.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:25.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:25.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:25.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:26.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:26.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:26.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:26.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:27.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:27.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:27.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:27.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:28.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:28.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:28.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:28.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:29.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:29.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:29.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:29.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:30.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:30.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:30.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:30.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:31.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:31.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:31.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:31.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:32.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:32.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:32.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:32.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:33.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:33.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:33.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:33.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:34.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:34.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:34.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:34.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:35.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:35.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:35.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:35.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:36.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:36.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:36.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:36.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:37.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:37.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:37.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:37.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:38.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:38.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:38.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:38.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:39.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:39.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:39.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:39.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:40.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:40.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:40.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:40.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:41.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:41.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:41.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:41.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:42.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:42.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:42.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:42.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:43.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:43.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:43.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:43.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:44.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:44.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:44.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:44.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:45.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:45.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:45.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:45.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:46.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:46.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:46.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:46.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:47.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:47.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:47.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:47.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:48.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:48.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:48.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:48.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:49.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:49.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:49.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:49.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:50.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:50.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:50.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:50.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:51.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:51.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:51.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:51.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:52.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:52.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:52.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:52.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:53.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:53.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:53.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:53.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:54.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:54.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:54.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:54.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:55.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:55.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:55.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:55.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:56.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:56.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:56.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:56.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:57.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:57.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:57.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:57.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:58.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:58.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:58.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:58.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:59.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:46:59.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:46:59.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:46:59.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:00.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:00.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:00.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:00.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:01.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:01.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:01.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:01.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:02.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:02.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:02.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:02.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:03.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:03.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:03.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:04.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:04.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:04.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:05.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:05.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:05.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:05.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:06.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:06.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:06.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:06.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:07.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:07.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:07.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:07.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:08.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:08.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:08.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:08.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:09.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:09.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:09.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:09.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:10.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:10.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:10.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:10.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:11.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:11.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:11.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:11.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:12.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:12.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:12.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:12.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:13.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:13.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:13.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:13.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:14.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:14.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:14.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:14.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:15.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:15.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:15.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:15.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:15.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:16.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:16.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:16.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:16.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:16.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:16.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:16.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:17.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:17.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:17.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:17.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:18.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:18.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:18.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:18.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:19.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:19.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:19.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:19.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:20.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:20.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:20.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:21.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:21.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:21.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:22.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:22.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:22.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:22.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:23.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:23.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:23.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:23.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:24.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:24.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:24.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:24.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:25.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:25.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:25.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:25.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:26.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:26.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:26.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:26.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:27.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:27.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:27.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:27.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:28.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:28.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:28.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:28.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:29.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:29.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:29.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:29.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:30.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:30.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:30.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:30.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:31.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:31.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:31.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:31.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:32.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:32.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:32.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:32.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:33.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:33.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:33.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:33.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:34.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:34.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:34.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:34.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:35.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:35.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:35.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:35.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:36.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:36.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:36.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:36.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:37.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:37.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:37.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:37.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:38.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:38.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:38.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:38.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:39.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:39.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:39.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:39.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:40.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:40.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:40.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:40.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:41.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:41.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:41.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:41.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:42.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:42.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:42.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:42.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:43.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:43.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:43.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:43.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:44.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:44.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:44.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:44.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:45.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:45.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:45.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:45.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:46.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:46.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:46.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:46.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:47.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:47.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:47.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:47.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:48.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:48.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:48.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:48.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:49.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:49.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:49.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:49.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:50.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:50.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:50.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:50.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:51.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:51.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:51.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:51.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:52.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:52.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:52.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:52.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:53.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:53.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:53.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:53.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:54.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:54.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:54.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:54.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:55.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:55.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:55.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:55.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:56.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:56.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:56.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:56.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:57.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:57.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:57.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:57.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:58.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:58.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:58.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:58.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:59.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:47:59.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:47:59.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:47:59.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:00.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:00.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:00.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:00.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:01.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:01.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:01.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:01.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:02.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:02.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:02.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:02.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:03.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:03.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:03.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:03.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:04.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:04.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:04.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:04.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:05.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:05.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:05.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:05.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:06.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:06.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:06.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:06.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:07.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:07.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:07.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:07.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:08.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:08.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:08.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:08.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:09.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:09.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:09.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:09.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:10.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:10.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:10.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:10.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:11.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:11.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:11.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:11.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:12.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:12.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:12.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:12.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:13.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:13.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:13.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:13.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:14.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:14.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:14.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:14.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:15.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:15.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:15.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:15.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:16.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:16.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:16.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:16.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:17.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:17.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:17.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:17.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:18.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:18.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:18.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:18.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:19.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:19.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:19.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:19.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:20.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:20.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:20.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:20.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:21.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:21.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:21.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:21.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:22.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:22.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:22.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:22.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:23.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:23.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:23.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:23.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:24.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:24.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:24.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:24.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:25.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:25.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:25.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:25.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:26.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:26.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:26.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:26.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:27.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:27.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:27.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:27.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:28.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:28.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:28.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:28.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:29.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:29.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:29.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:29.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:30.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:30.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:30.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:30.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:31.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:31.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:31.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:31.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:32.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:32.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:32.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:32.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:33.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:33.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:33.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:33.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:34.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:34.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:34.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:34.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:35.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:35.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:35.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:35.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:36.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:36.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:36.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:36.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:37.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:37.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:37.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:37.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:38.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:38.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:38.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:38.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:39.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:39.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:39.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:39.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:40.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:40.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:40.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:40.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:41.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:41.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:41.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:41.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:42.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:42.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:42.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:42.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:43.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:43.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:43.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:43.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:44.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:44.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:44.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:44.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:45.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:45.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:45.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:45.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:46.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:46.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:46.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:46.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:47.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:47.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:47.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:47.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:48.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:48.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:48.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:48.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:49.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:49.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:49.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:49.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:50.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:50.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:50.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:50.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:51.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:51.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:51.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:51.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:52.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:52.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:52.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:52.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:53.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:53.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:53.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:53.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:54.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:54.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:54.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:54.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:55.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:55.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:55.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:55.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:56.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:56.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:56.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:56.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:57.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:57.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:57.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:57.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:58.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:58.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:58.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:58.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:59.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:48:59.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:48:59.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:48:59.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:00.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:00.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:00.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:00.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:01.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:01.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:01.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:01.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:02.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:02.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:02.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:02.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:03.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:03.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:03.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:03.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:04.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:04.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:04.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:04.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:05.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:05.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:05.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:05.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:06.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:06.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:06.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:06.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:07.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:07.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:07.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:07.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:08.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:08.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:08.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:08.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:09.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:09.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:09.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:09.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:10.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:10.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:10.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:10.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:11.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:11.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:11.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:11.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:12.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:12.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:12.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:12.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:13.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:13.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:13.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:13.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:14.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:14.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:14.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:14.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:15.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:15.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:15.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:15.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:16.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:16.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:16.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:16.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:17.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:17.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:17.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:17.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:18.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:18.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:18.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:18.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:19.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:19.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:19.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:19.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:20.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:20.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:20.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:20.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:21.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:21.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:21.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:21.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:22.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:22.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:22.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:22.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:23.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:23.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:23.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:23.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:24.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:24.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:24.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:24.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:25.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:25.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:25.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:25.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:26.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:26.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:26.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:26.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:27.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:27.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:27.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:27.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:28.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:28.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:28.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:28.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:29.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:29.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:29.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:29.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:30.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:30.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:30.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:30.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:31.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:31.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:31.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:31.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:32.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:32.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:32.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:32.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:33.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:33.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:33.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:33.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:34.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:34.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:34.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:34.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:35.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:35.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:35.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:35.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:36.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:36.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:36.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:36.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:37.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:37.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:37.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:37.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:38.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:38.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:38.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:38.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:39.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:39.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:39.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:39.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:40.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:40.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:40.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:40.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:41.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:41.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:41.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:41.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:42.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:42.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:42.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:42.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:43.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:43.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:43.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:43.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:44.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:44.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:44.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:44.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:45.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:45.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:45.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:45.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:46.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:46.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:46.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:46.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:47.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:47.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:47.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:47.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:48.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:48.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:48.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:48.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:49.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:49.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:49.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:49.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:50.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:50.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:50.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:50.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:51.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:51.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:51.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:51.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:52.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:52.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:52.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:52.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:53.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:53.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:53.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:53.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:54.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:54.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:54.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:54.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:55.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:55.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:55.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:55.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:56.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:56.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:56.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:56.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:57.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:57.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:57.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:57.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:58.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:58.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:58.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:58.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:59.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:49:59.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:49:59.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:49:59.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:00.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:00.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:00.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:00.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:01.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:01.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:01.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:01.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:02.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:02.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:02.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:02.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:02.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:03.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:03.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:03.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:03.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:04.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:04.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:04.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:04.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:05.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:05.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:05.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:05.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:05.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:06.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:06.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:06.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:06.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:07.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:07.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:07.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:07.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:08.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:08.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:08.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:08.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:09.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:09.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:09.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:09.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:10.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:10.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:10.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:10.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:11.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:11.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:11.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:11.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:12.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:12.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:12.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:12.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:13.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:13.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:13.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:13.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:14.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:14.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:14.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:14.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:15.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:15.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:15.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:15.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:16.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:16.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:16.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:17.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:17.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:17.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:18.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:18.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:18.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:18.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:19.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:19.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:19.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:19.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:20.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:20.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:20.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:20.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:21.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:21.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:21.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:21.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:21.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:21.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:22.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:22.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:22.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:22.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:23.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:23.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:23.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:24.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:24.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:24.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:24.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:25.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:25.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:25.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:26.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:26.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:26.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:26.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:26.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:26.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:27.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:27.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:27.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:27.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:28.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:28.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:28.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:29.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:29.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:29.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:29.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:30.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:30.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:30.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:30.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:30.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:31.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:31.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:31.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:31.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:32.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:32.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:32.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:32.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:33.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:33.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:33.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:33.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:34.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:34.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:34.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:34.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:35.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:35.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:35.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:35.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:36.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:36.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:36.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:36.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:37.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:37.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:37.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:37.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:38.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:38.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:38.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:38.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:39.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:39.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:39.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:39.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:40.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:40.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:40.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:40.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:41.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:41.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:41.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:41.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:42.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:42.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:42.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:42.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:43.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:43.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:43.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:43.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:44.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:44.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:44.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:44.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:45.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:45.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:45.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:45.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:46.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:46.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:46.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:46.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:47.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:47.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:47.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:47.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:48.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:48.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:48.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:48.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:49.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:49.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:49.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:49.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:50.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:50.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:50.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:50.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:51.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:51.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:51.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:51.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:52.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:52.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:52.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:52.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:53.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:53.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:53.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:53.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:54.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:54.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:54.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:54.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:55.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:55.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:55.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:55.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:56.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:56.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:56.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:56.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:57.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:57.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:57.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:57.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:58.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:58.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:58.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:58.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:59.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:50:59.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:50:59.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:50:59.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:00.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:00.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:00.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:00.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:01.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:01.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:01.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:01.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:02.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:02.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:02.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:02.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:03.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:03.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:03.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:03.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:04.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:04.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:04.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:04.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:05.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:05.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:05.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:05.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:06.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:06.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:06.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:06.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:07.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:07.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:07.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:07.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:08.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:08.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:08.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:08.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:09.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:09.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:09.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:09.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:10.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:10.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:10.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:10.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:11.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:11.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:11.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:11.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:12.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:12.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:12.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:12.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:13.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:13.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:13.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:13.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:14.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:14.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:14.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:14.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:15.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:15.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:15.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:15.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:16.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:16.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:16.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:16.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:17.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:17.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:17.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:17.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:18.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:18.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:18.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:19.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:19.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:19.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:20.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:20.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:20.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:20.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:21.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:21.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:21.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:21.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:22.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:22.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:22.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:22.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:22.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:23.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:23.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:23.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:23.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:23.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:24.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:24.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:24.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:24.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:25.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:25.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:25.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:25.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:26.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:26.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:26.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:26.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:27.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:27.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:27.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:27.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:28.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:28.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:28.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:28.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:29.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:29.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:29.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:29.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:30.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:30.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:30.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:30.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:31.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:31.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:31.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:31.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:32.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:32.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:32.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:32.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:33.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:33.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:33.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:33.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:34.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:34.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:34.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:34.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:35.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:35.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:35.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:35.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:36.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:36.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:36.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:36.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:37.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:37.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:37.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:37.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:38.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:38.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:38.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:38.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:39.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:39.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:39.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:39.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:40.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:40.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:40.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:40.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:41.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:41.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:41.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:41.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:42.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:42.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:42.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:42.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:43.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:43.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:43.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:43.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:44.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:44.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:44.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:44.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:45.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:45.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:45.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:45.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:46.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:46.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:46.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:46.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:47.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:47.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:47.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:47.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:48.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:48.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:48.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:48.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:49.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:49.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:49.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:49.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:50.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:50.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:50.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:50.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:51.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:51.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:51.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:51.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:52.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:52.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:52.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:52.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:53.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:53.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:53.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:53.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:54.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:54.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:54.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:54.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:55.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:55.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:55.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:55.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:56.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:56.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:56.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:56.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:57.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:57.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:57.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:58.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:58.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:58.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:58.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:51:58.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:51:59.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:51:59.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:00.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:00.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:00.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:00.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:00.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:00.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:01.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:01.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:01.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:01.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:02.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:02.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:02.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:02.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:03.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:03.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:03.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:03.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:04.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:04.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:04.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:04.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:05.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:05.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:05.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:05.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:06.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:06.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:06.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:06.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:07.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:07.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:07.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:08.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:08.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:08.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:09.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:09.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:09.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:09.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:09.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:09.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:10.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:10.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:10.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:10.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:11.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:11.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:11.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:12.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:12.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:12.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:13.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:13.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:13.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:13.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:14.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:14.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:14.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:14.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:15.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:15.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:15.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:15.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:16.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:16.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:16.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:16.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:17.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:17.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:17.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:17.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:18.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:18.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:18.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:18.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:19.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:19.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:19.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:19.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:20.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:20.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:20.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:20.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:21.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:21.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:21.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:21.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:22.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:22.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:22.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:22.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:23.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:23.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:23.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:23.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:24.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:24.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:24.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:24.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:25.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:25.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:25.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:25.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:26.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:26.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:26.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:26.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:27.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:27.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:27.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:27.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:28.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:28.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:28.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:28.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:29.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:29.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:29.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:29.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:30.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:30.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:30.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:30.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:31.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:31.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:31.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:31.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:32.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:32.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:32.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:32.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:33.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:33.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:33.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:33.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:34.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:34.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:34.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:34.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:35.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:35.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:35.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:35.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:36.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:36.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:36.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:36.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:37.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:37.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:37.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:37.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:38.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:38.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:38.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:38.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:39.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:39.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:39.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:39.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:40.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:40.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:40.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:40.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:41.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:41.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:41.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:41.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:42.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:42.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:42.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:42.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:43.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:43.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:43.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:43.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:44.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:44.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:44.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:44.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:45.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:45.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:45.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:45.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:46.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:46.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:46.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:46.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:47.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:47.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:47.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:47.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:48.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:48.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:48.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:48.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:49.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:49.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:49.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:49.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:50.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:50.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:50.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:50.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:51.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:51.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:51.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:51.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:52.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:52.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:52.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:52.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:53.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:53.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:53.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:53.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:54.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:54.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:54.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:54.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:55.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:55.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:55.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:55.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:55.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:56.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:56.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:56.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:56.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:57.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:57.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:57.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:57.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:57.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:58.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:58.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:58.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:58.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:59.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:52:59.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:52:59.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:52:59.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:00.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:00.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:00.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:00.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:01.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:01.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:01.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:01.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:02.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:02.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:02.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:03.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:03.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:03.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:03.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:03.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:04.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:04.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:04.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:04.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:05.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:05.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:05.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:05.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:06.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:06.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:06.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:06.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:07.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:07.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:07.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:07.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:08.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:08.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:08.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:08.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:09.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:09.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:09.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:09.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:10.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:10.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:10.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:10.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:11.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:11.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:11.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:11.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:12.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:12.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:12.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:12.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:13.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:13.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:13.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:13.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:14.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:14.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:14.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:14.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:15.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:15.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:15.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:15.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:16.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:16.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:16.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:16.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:17.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:17.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:17.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:17.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:18.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:18.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:18.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:18.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:19.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:19.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:19.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:19.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:20.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:20.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:20.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:20.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:21.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:21.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:22.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:22.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:22.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:22.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:22.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:23.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:23.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:23.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:24.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:24.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:24.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:24.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:24.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:24.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:25.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:25.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:25.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:25.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:26.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:26.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:26.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:26.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:27.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:27.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:27.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:27.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:28.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:28.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:28.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:28.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:29.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:29.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:29.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:29.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:30.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:30.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:30.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:31.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:31.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:31.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:32.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:32.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:32.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:32.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:33.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:33.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:33.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:33.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:34.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:34.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:34.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:34.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:35.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:35.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:35.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:35.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:36.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:36.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:36.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:36.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:37.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:37.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:37.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:37.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:38.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:38.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:38.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:38.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:39.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:39.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:39.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:39.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:40.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:40.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:40.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:40.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:41.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:41.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:41.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:41.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:42.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:42.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:42.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:42.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:43.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:43.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:43.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:43.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:44.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:44.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:44.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:44.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:45.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:45.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:45.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:45.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:46.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:46.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:46.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:46.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:47.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:47.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:47.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:47.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:48.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:48.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:48.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:48.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:49.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:49.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:49.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:49.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:50.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:50.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:50.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:50.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:51.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:51.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:51.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:51.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:52.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:52.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:52.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:52.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:53.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:53.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:53.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:53.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:54.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:54.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:54.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:54.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:55.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:55.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:55.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:55.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:56.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:56.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:56.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:56.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:57.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:57.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:57.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:57.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:58.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:58.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:58.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:58.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:59.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:53:59.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:53:59.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:53:59.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:00.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:00.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:00.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:00.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:01.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:01.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:01.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:01.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:02.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:02.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:02.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:02.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:03.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:03.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:03.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:03.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:04.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:04.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:04.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:04.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:05.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:05.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:05.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:05.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:06.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:06.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:06.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:06.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:07.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:07.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:07.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:07.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:08.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:08.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:08.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:08.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:09.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:09.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:09.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:09.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:10.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:10.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:10.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:10.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:11.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:11.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:11.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:11.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:12.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:12.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:12.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:12.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:13.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:13.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:13.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:13.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:14.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:14.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:14.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:14.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:15.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:15.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:15.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:15.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:16.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:16.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:16.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:16.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:17.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:17.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:17.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:17.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:18.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:18.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:18.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:18.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:18.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:19.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:19.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:19.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:19.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:19.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:20.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:20.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:20.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:20.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:21.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:21.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:21.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:21.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:22.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:22.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:22.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:22.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:23.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:23.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:23.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:23.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:24.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:24.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:24.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:24.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:25.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:25.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:25.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:25.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:26.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:26.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:26.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:26.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:27.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:27.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:27.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:27.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:28.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:28.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:28.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:28.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:29.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:29.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:29.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:29.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:30.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:30.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:30.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:30.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:31.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:31.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:31.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:31.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:32.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:32.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:32.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:32.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:33.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:33.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:33.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:33.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:34.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:34.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:34.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:34.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:35.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:35.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:36.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:36.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:36.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:36.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:37.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:37.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:37.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:37.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:37.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:38.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:38.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:38.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:39.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:39.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:39.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:39.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:40.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:40.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:40.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:40.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:40.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:40.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:41.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:41.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:41.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:42.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:42.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:42.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:42.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:42.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:43.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:43.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:43.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:43.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:44.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:44.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:44.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:45.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:45.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:45.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:45.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:45.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:46.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:46.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:46.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:46.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:47.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:47.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:47.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:47.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:48.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:48.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:48.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:48.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:49.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:49.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:49.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:50.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:50.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:50.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:50.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:50.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:51.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:51.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:51.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:52.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:52.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:52.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:52.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:52.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:53.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:53.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:53.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:53.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:54.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:54.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:54.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:54.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:55.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:55.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:55.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:55.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:56.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:56.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:56.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:56.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:57.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:57.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:57.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:57.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:58.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:58.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:58.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:58.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:59.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:54:59.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:54:59.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:54:59.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:00.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:00.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:00.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:00.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:01.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:01.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:01.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:01.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:02.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:02.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:02.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:02.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:03.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:03.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:03.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:03.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:04.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:04.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:04.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:04.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:05.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:05.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:05.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:05.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:06.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:06.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:06.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:06.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:07.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:07.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:07.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:07.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:08.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:08.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:08.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:08.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:09.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:09.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:09.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:09.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:10.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:10.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:10.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:10.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:11.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:11.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:11.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:11.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:11.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:12.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:12.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:12.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:12.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:12.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:13.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:13.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:14.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:14.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:14.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:14.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:14.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:14.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:15.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:15.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:16.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:16.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:16.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:16.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:16.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:17.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:17.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:17.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:18.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:18.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:18.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:18.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:19.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:19.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:19.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:19.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:20.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:20.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:20.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:20.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:21.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:21.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:21.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:21.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:22.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:22.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:22.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:22.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:23.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:23.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:23.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:23.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:24.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:24.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:24.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:24.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:25.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:25.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:25.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:25.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:26.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:26.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:26.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:26.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:27.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:27.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:27.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:27.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:28.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:28.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:28.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:28.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:29.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:29.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:29.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:29.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:30.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:30.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:30.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:30.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:31.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:31.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:31.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:31.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:32.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:32.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:32.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:32.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:33.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:33.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:33.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:33.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:34.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:34.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:34.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:34.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:35.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:35.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:35.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:35.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:36.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:36.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:36.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:36.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:37.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:37.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:37.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:37.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:38.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:38.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:38.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:38.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:39.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:39.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:39.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:39.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:40.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:40.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:40.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:40.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:41.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:41.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:41.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:41.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:42.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:42.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:42.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:42.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:43.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:43.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:43.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:43.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:44.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:44.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:44.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:44.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:45.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:45.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:45.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:45.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:46.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:46.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:46.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:46.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:47.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:47.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:47.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:47.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:48.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:48.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:48.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:48.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:49.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:49.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:49.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:49.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:50.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:50.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:50.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:50.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:51.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:51.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:51.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:51.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:51.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:52.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:52.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:52.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:52.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:52.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:53.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:53.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:54.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:54.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:54.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:54.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:55.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:55.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:55.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:55.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:55.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:56.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:56.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:56.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:56.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:57.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:57.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:57.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:57.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:57.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:58.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:58.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:58.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:58.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:59.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:55:59.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:55:59.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:55:59.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:00.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:00.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:01.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:01.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:01.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:01.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:02.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:02.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:02.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:02.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:03.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:03.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:03.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:03.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:04.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:04.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:04.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:04.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:04.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:05.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:05.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:05.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:05.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:05.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:06.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:06.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:06.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:06.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:07.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:07.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:08.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:08.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:08.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:08.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:09.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:09.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:09.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:09.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:10.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:10.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:10.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:10.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:11.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:11.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:11.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:11.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:12.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:12.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:12.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:12.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:13.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:13.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:13.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:13.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:14.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:14.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:14.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:14.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:15.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:15.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:15.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:15.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:16.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:16.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:16.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:16.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:17.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:17.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:17.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:17.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:18.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:18.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:18.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:18.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:19.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:19.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:19.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:19.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:20.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:20.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:20.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:20.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:21.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:21.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:21.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:21.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:22.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:22.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:22.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:22.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:23.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:23.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:23.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:23.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:24.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:24.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:24.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:24.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:25.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:25.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:25.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:25.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:26.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:26.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:26.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:26.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:27.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:27.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:27.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:27.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:28.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:28.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:28.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:28.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:29.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:29.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:29.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:29.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:30.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:30.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:30.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:30.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:31.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:31.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:31.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:31.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:32.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:32.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:32.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:32.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:33.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:33.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:33.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:33.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:34.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:34.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:34.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:34.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:35.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:35.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:35.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:35.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:35.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:36.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:36.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:36.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:36.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:37.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:37.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:37.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:37.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:38.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:38.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:38.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:38.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:38.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:38.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:39.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:39.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:39.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:40.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:40.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:40.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:40.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:41.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:41.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:41.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:41.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:41.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:42.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:42.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:42.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:42.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:43.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:43.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:43.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:44.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:44.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:44.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:44.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:45.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:45.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:45.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:46.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:46.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:46.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:46.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:46.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:46.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:47.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:47.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:47.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:47.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:47.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:48.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:48.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:48.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:48.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:49.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:49.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:49.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:49.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:50.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:50.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:50.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:50.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:51.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:51.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:51.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:51.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:52.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:52.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:52.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:52.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:53.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:53.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:53.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:53.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:54.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:54.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:54.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:54.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:55.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:55.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:55.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:56.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:56.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:56.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:57.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:57.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:57.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:57.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:58.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:58.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:58.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:58.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:59.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:56:59.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:56:59.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:56:59.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:00.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:00.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:00.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:00.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:01.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:01.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:01.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:01.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:02.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:02.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:02.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:02.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:03.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:03.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:03.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:03.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:04.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:04.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:04.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:04.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:05.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:05.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:05.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:05.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:06.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:06.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:06.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:06.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:07.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:07.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:07.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:07.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:08.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:08.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:08.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:08.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:09.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:09.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:09.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:09.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:10.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:10.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:10.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:10.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:11.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:11.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:11.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:11.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:12.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:12.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:12.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:12.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:13.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:13.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:13.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:13.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:14.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:14.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:14.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:14.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:15.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:15.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:15.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:15.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:16.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:16.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:16.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:16.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:17.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:17.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:17.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:17.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:18.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:18.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:18.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:18.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:19.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:19.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:19.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:19.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:20.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:20.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:20.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:20.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:21.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:21.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:21.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:21.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:22.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:22.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:22.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:22.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:23.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:23.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:23.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:23.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:23.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:24.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:24.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:24.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:25.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:25.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:25.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:25.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:26.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:26.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:26.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:26.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:27.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:27.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:27.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:27.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:28.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:28.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:28.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:28.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:29.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:29.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:29.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:29.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:30.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:30.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:30.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:30.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:31.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:31.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:31.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:31.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:31.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:32.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:32.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:32.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:32.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:32.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:33.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:33.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:33.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:34.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:34.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:34.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:35.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:35.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:35.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:35.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:35.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:36.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:36.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:36.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:36.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:36.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:37.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:37.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:38.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:38.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:38.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:38.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:39.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:39.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:39.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:39.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:40.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:40.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:40.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:40.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:41.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:41.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:41.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:41.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:42.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:42.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:42.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:43.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:43.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:43.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:44.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:44.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:44.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:44.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:45.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:45.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:45.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:45.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:46.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:46.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:46.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:46.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:47.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:47.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:47.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:47.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:48.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:48.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:48.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:48.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:49.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:49.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:49.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:49.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:50.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:50.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:50.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:50.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:51.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:51.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:51.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:51.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:52.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:52.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:52.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:52.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:53.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:53.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:53.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:53.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:54.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:54.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:54.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:54.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:55.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:55.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:55.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:55.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:56.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:56.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:56.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:56.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:56.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:56.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:57.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:57.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:58.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:58.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:58.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:58.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:59.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:57:59.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:57:59.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:57:59.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:00.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:00.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:00.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:00.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:01.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:01.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:01.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:01.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:02.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:02.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:02.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:02.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:03.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:03.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:03.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:03.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:04.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:04.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:04.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:04.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:05.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:05.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:05.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:05.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:06.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:06.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:06.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:06.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:07.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:07.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:07.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:07.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:08.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:08.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:08.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:08.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:09.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:09.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:09.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:09.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:10.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:10.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:10.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:10.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:11.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:11.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:11.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:11.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:12.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:12.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:12.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:12.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:13.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:13.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:13.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:13.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:14.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:14.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:14.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:14.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:15.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:15.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:15.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:15.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:16.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:16.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:16.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:16.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:17.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:17.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:17.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:17.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:18.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:18.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:18.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:18.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:19.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:19.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:19.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:19.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:20.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:20.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:20.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:20.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:21.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:21.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:21.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:21.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:22.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:22.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:22.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:22.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:23.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:23.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:23.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:23.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:24.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:24.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:24.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:24.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:25.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:25.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:25.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:25.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:26.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:26.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:26.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:26.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:27.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:27.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:27.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:27.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:28.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:28.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:28.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:28.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:29.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:29.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:29.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:29.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:30.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:30.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:30.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:30.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:31.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:31.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:31.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:31.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:32.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:32.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:32.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:32.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:33.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:33.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:33.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:33.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:34.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:34.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:34.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:34.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:35.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:35.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:35.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:35.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:36.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:36.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:36.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:36.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:37.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:37.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:37.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:37.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:38.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:38.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:38.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:38.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:39.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:39.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:39.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:39.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:40.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:40.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:40.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:40.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:41.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:41.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:41.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:41.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:42.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:42.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:42.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:42.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:43.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:43.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:43.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:43.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:44.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:44.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:44.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:44.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:45.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:45.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:45.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:45.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:46.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:46.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:46.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:46.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:47.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:47.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:47.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:47.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:48.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:48.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:48.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:48.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:49.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:49.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:49.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:49.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:50.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:50.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:50.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:50.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:51.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:51.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:51.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:51.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:52.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:52.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:52.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:52.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:53.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:53.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:53.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:53.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:54.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:54.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:54.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:54.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:55.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:55.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:55.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:55.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:56.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:56.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:56.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:56.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:57.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:57.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:57.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:57.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:58.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:58.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:58.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:58.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:59.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:58:59.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:58:59.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:58:59.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:00.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:00.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:00.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:00.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:01.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:01.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:01.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:01.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:02.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:02.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:02.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:02.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:03.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:03.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:03.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:03.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:04.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:04.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:04.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:04.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:05.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:05.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:05.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:05.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:06.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:06.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:06.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:06.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:07.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:07.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:07.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:07.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:08.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:08.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:08.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:08.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:09.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:09.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:09.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:09.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:10.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:10.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:10.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:10.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:11.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:11.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:11.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:11.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:12.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:12.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:12.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:12.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:13.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:13.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:13.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:13.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:14.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:14.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:14.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:14.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:15.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:15.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:15.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:15.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:16.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:16.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:16.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:16.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:17.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:17.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:17.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:17.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:18.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:18.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:18.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:18.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:19.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:19.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:19.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:19.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:20.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:20.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:20.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:20.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:21.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:21.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:21.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:21.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:22.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:22.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:22.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:22.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:23.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:23.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:23.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:23.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:24.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:24.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:24.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:24.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:25.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:25.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:25.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:25.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:26.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:26.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:26.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:26.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:27.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:27.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:27.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:27.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:28.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:28.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:28.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:28.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:29.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:29.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:29.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:29.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:30.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:30.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:30.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:30.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:31.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:31.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:31.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:31.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:32.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:32.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:32.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:32.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:33.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:33.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:33.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:33.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:34.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:34.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:34.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:34.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:34.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:35.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:35.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:35.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:35.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:35.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:36.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:36.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:37.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:37.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:37.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:37.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:37.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:37.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:38.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:38.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:38.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:38.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:39.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:39.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:39.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:39.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:40.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:40.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:40.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:40.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:41.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:41.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:41.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:42.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:42.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:42.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:43.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:43.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:43.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:43.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:44.067 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T18:59:44.081+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac035cc0 msgr2=0x7f81ac0380a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T18:59:44.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:44.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:44.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:44.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:45.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:45.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:45.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:45.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:46.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:46.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:46.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:46.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:47.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:47.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:47.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:47.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:48.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:48.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:48.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:48.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:49.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:49.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:49.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:49.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:50.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:50.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:50.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:50.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:51.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:51.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:51.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:51.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:52.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:52.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:52.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:52.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:53.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:53.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:53.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:53.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:54.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:54.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:54.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:54.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:55.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:55.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:55.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:55.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:56.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:56.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:56.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:56.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:57.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:57.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:57.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:57.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:58.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:58.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:58.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:58.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:59.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T18:59:59.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T18:59:59.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T18:59:59.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:00.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:00.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:00.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:00.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:01.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:01.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:01.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:01.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:02.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:02.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:02.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:02.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:03.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:03.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:03.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:03.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:04.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:04.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:04.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:04.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:05.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:05.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:05.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:05.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:06.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:06.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:06.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:06.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:07.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:07.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:07.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:07.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:08.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:08.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:08.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:08.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:09.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:09.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:09.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:09.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:10.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:10.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:10.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:10.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:11.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:11.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:11.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:11.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:12.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:12.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:12.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:12.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:13.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:13.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:13.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:13.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:14.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:14.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:14.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:14.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:15.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:15.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:15.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:15.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:16.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:16.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:16.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:16.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:17.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:17.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:17.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:17.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:18.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:18.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:18.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:18.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:19.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:19.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:19.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:19.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:20.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:20.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:20.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:20.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:21.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:21.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:21.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:21.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:22.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:22.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:22.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:22.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:23.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:23.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:23.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:23.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:24.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:24.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:24.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:24.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:25.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:25.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:25.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:25.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:26.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:26.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:26.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:26.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:27.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:27.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:27.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:27.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:28.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:28.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:28.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:28.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:29.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:29.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:29.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:29.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:30.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:30.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:30.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:30.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:31.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:31.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:31.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:31.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:32.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:32.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:32.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:32.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:33.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:33.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 45 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:33.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:33.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:34.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:34.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:34.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:34.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:35.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:35.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:35.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:35.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:36.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:36.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:36.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:36.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:37.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:37.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:37.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:37.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:38.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:38.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:38.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:38.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:39.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:39.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:39.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:39.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:40.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:40.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:40.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:40.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:41.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:41.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:41.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:41.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:42.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:42.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:42.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:42.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:43.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:43.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:43.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:43.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:44.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:44.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:44.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:44.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:45.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:45.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:45.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:45.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:46.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:46.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:46.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:46.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:47.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:47.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:47.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:47.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:48.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:48.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:48.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:48.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:49.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:49.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:49.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:49.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:50.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:50.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:50.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:50.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:51.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:51.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:51.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:51.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:52.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:52.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:52.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:52.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:53.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:53.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:53.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:53.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:54.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:54.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:54.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:54.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:55.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:55.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:55.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:55.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:56.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:56.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:56.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:56.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:57.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:57.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:57.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:57.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:58.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:58.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:58.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:58.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:59.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:00:59.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:00:59.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:00:59.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:00.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:00.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:00.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:00.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:01.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:01.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:01.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:01.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:02.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:02.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:02.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:02.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:03.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:03.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 38 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:03.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:03.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:04.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:04.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:04.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:04.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:05.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:05.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:05.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:05.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:06.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:06.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:06.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:06.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:07.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:07.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:07.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:07.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:08.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:08.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:08.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:08.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:09.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:09.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:09.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:09.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:10.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:10.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:10.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:10.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:11.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:11.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:11.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:11.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:12.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:12.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:12.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:12.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:13.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:13.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:13.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:13.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:14.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:14.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:14.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:14.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:15.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:15.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:15.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:15.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:16.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:16.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:16.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:16.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:17.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:17.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:17.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:17.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:18.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:18.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:18.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:18.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:19.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:19.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:19.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:19.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:20.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:20.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:20.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:20.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:21.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:21.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:21.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:21.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:22.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:22.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:22.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:22.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:23.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:23.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:23.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:23.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:24.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:24.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:24.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:24.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:25.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:25.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:25.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:25.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:26.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:26.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:26.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:26.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:27.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:27.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:27.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:27.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:28.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:28.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:28.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:28.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:29.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:29.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:29.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:29.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:30.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:30.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:30.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:30.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:31.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:31.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:31.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:31.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:32.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:32.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:32.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:32.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:33.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:33.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:33.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:33.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:34.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:34.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:34.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:34.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:35.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:35.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:35.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:35.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:36.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:36.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:36.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:36.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:37.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:37.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:37.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:37.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:38.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:38.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:38.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:38.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:39.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:39.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:39.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:39.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:40.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:40.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:40.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:40.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:41.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:41.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:41.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:41.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:42.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:42.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:42.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:42.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:43.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:43.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:43.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:43.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:44.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:44.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:44.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:44.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:45.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:45.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:45.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:45.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:46.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:46.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:46.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:46.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:47.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:47.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:47.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:47.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:48.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:48.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:48.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:48.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:49.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:49.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:49.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:49.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:50.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:50.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:50.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:50.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:51.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:51.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:51.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:51.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:52.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:52.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:52.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:52.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:53.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:53.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:53.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:53.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:54.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:54.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:54.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:54.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:55.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:55.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:55.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:55.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:56.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:56.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:56.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:56.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:57.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:57.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:57.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:57.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:58.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:58.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:58.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:58.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:59.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:01:59.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:01:59.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:01:59.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:00.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:00.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:00.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:00.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:01.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:01.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:01.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:01.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:02.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:02.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:02.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:02.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:03.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:03.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:03.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:03.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:04.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:04.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:04.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:04.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:05.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:05.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:06.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:06.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:06.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:06.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:07.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:07.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:07.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:07.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:08.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:08.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:08.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:08.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:09.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:09.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:09.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:09.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:10.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:10.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:10.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:10.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:11.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:11.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:11.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:11.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:12.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:12.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:12.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:12.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:13.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:13.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:13.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:13.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:14.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:14.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:14.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:14.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:15.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:15.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:15.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:15.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:16.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:16.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:16.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:16.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:17.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:17.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:17.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:17.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:18.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:18.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:18.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:18.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:19.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:19.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:19.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:19.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:20.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:20.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:20.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:20.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:21.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:21.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:21.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:21.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:22.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:22.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:22.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:22.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:23.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:23.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:23.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:23.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:24.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:24.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:24.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:24.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:25.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:25.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:25.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:25.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:26.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:26.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:26.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:26.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:27.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:27.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:27.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:27.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:28.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:28.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:28.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:28.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:29.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:29.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:29.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:29.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:30.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:30.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:30.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:30.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:31.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:31.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:31.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:31.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:32.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:32.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:32.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:32.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:33.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:33.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:33.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:33.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:34.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:34.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:34.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:34.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:35.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:35.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:35.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:35.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:36.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:36.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:36.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:36.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:37.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:37.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:37.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:37.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:38.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:38.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:38.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:38.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:39.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:39.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:39.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:39.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:40.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:40.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:40.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:40.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:41.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:41.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:41.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:41.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:42.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:42.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:42.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:42.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:43.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:43.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:43.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:43.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:44.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:44.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:44.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:44.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:45.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:45.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:45.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:45.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:46.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:46.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:46.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:46.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:47.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:47.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:47.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:47.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:48.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:48.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:48.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:48.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:49.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:49.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:49.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:49.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:50.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:50.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:50.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:50.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:51.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:51.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:51.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:51.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:52.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:52.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:52.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:52.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:53.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:53.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:53.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:53.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:54.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:54.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:54.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:54.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:55.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:55.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:55.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:55.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:56.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:56.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:56.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:56.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:57.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:57.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:57.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:57.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:58.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:58.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:58.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:58.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:59.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:02:59.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:02:59.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:02:59.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:00.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:00.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:00.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:00.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:01.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:01.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:01.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:01.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:02.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:02.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:02.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:02.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:03.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:03.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:03.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:03.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:04.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:04.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:04.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:04.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:05.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:05.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:05.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:05.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:06.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:06.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:06.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:06.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:07.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:07.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:07.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:07.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:08.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:08.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:08.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:08.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:09.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:09.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:09.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:09.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:10.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:10.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:10.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:10.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:11.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:11.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:11.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:11.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:12.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:12.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:12.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:12.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:13.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:13.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:13.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:13.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:14.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:14.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:14.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:14.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:15.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:15.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:15.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:15.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:16.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:16.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:16.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:16.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:17.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:17.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:17.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:17.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:18.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:18.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:18.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:18.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:19.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:19.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:19.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:19.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:20.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:20.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:20.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:20.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:21.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:21.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:21.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:21.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:22.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:22.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:22.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:22.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:23.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:23.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:23.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:23.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:24.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:24.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:24.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:24.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:25.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:25.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:25.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:25.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:26.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:26.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:26.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:26.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:27.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:27.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:27.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:27.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:28.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:28.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:28.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:28.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:29.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:29.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:29.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:29.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:30.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:30.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:30.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:30.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:31.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:31.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:31.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:31.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:32.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:32.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:32.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:32.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:33.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:33.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:33.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:33.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:34.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:34.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:34.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:34.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:35.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:35.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:35.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:35.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:36.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:36.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:36.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:36.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:37.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:37.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:37.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:37.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:38.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:38.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:38.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:38.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:39.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:39.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:39.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:39.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:40.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:40.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:40.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:40.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:41.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:41.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:41.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:41.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:42.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:42.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:42.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:42.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:43.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:43.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:43.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:43.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:44.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:44.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:44.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:44.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:45.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:45.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:45.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:45.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:46.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:46.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:46.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:46.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:47.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:47.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:47.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:47.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:48.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:48.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:48.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:48.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:49.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:49.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:49.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:49.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:50.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:50.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:50.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:50.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:51.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:51.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:51.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:51.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:52.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:52.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:52.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:52.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:53.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:53.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:53.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:53.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:54.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:54.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:54.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:54.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:55.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:55.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:55.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:55.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:56.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:56.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:56.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:56.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:57.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:57.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:57.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:57.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:58.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:58.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:58.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:58.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:59.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:03:59.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:03:59.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:03:59.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:00.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:00.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:00.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:00.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:01.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:01.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:01.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:01.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:02.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:02.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:02.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:02.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:03.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:03.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:03.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:03.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:04.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:04.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:04.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:04.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:05.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:05.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:05.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:05.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:06.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:06.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:06.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:06.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:07.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:07.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:07.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:07.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:08.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:08.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:08.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:08.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:09.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:09.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:09.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:09.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:10.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:10.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:10.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:10.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:11.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:11.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:11.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:11.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:12.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:12.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:12.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:12.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:12.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:12.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:13.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:13.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:13.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:14.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:14.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:14.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:15.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:15.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:15.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:15.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:15.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:15.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:16.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:16.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:16.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:16.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:17.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:17.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:17.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:17.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:18.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:18.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:19.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:19.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:19.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:19.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:20.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:20.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:20.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:20.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:20.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:21.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:21.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:21.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:22.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:22.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:22.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:22.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:22.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:23.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:23.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:23.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:23.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:23.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:24.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:24.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:24.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:24.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:25.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:25.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:25.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:25.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:26.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:26.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:26.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:26.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:27.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:27.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:27.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:27.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:28.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:28.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:28.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:28.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:29.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:29.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:29.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:29.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:30.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:30.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:30.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:30.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:31.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:31.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:31.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:31.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:32.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:32.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:32.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:32.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:33.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:33.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:33.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:34.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:34.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:34.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:34.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:34.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:35.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:35.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:35.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:35.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:36.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:36.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:36.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:36.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:37.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:37.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:37.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:37.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:38.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:38.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:38.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:38.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:39.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:39.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:39.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:39.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:40.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:40.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:40.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:40.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:41.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:41.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:41.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:41.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:42.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:42.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:42.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:42.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:43.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:43.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:43.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:43.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:44.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:44.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:44.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:44.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:45.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:45.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:45.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:45.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:46.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:46.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:47.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:47.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:47.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:47.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:47.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:47.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:48.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:48.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:48.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:49.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:49.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:49.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:49.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:49.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:50.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:50.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:50.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:50.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:51.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:51.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:51.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:52.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:52.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:52.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:52.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:52.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:53.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:53.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:53.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:53.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:54.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:54.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:54.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:54.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:55.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:55.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:55.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:55.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:56.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:56.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:56.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:56.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:57.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:57.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:57.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:57.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:58.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:58.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:58.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:58.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:59.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:04:59.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:04:59.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:04:59.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:00.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:00.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:00.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:00.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:01.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:01.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:01.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:01.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:02.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:02.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:02.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:02.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:03.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:03.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:03.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:03.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:04.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:04.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:04.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:04.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:05.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:05.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:05.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:05.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:06.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:06.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:06.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:06.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:07.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:07.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:07.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:07.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:08.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:08.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:08.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:08.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:09.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:09.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:09.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:09.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:10.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:10.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:10.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:10.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:11.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:11.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:11.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:11.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:12.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:12.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:12.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:12.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:13.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:13.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:13.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:13.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:14.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:14.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:14.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:14.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:15.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:15.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:15.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:15.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:16.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:16.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:16.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:16.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:17.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:17.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:17.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:17.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:18.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:18.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:18.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:18.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:19.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:19.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:19.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:19.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:20.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:20.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:20.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:20.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:21.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:21.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:21.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:21.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:22.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:22.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:22.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:22.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:23.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:23.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:23.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:23.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:24.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:24.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:24.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:24.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:25.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:25.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:25.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:25.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:26.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:26.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:26.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:26.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:27.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:27.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:27.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:27.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:28.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:28.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:28.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:28.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:29.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:29.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:29.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:29.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:30.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:30.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:30.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:30.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:31.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:31.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:31.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:31.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:32.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:32.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:32.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:32.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:33.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:33.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:33.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:33.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:34.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:34.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:34.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:34.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:35.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:35.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:35.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:35.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:36.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:36.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:36.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:36.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:37.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:37.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:37.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:37.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:38.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:38.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:38.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:38.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:39.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:39.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:39.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:39.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:40.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:40.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:40.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:40.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:41.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:41.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:41.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:41.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:42.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:42.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:42.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:42.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:43.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:43.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:43.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:43.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:44.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:44.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:44.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:44.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:45.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:45.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:45.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:45.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:46.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:46.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:46.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:46.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:47.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:47.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:47.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:47.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:48.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:48.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:48.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:48.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:49.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:49.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:49.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:49.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:50.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:50.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:50.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:50.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:51.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:51.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:51.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:51.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:52.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:52.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:52.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:52.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:53.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:53.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:53.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:53.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:54.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:54.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:54.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:54.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:55.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:55.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:55.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:55.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:56.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:56.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:56.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:56.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:57.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:57.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:57.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:57.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:58.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:58.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:58.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:58.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:59.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:05:59.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:05:59.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:05:59.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:00.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:00.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:00.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:00.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:01.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:01.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:01.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:01.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:02.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:02.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:02.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:02.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:03.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:03.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:03.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:03.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:04.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:04.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:04.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:04.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:05.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:05.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:05.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:05.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:06.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:06.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:06.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:06.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:07.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:07.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:07.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:07.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:08.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:08.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:08.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:08.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:09.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:09.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:09.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:09.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:10.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:10.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:10.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:10.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:11.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:11.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:11.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:11.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:12.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:12.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:12.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:12.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:13.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:13.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:13.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:13.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:14.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:14.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:14.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:14.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:15.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:15.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:15.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:15.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:16.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:16.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:16.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:16.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:17.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:17.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:17.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:18.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:18.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:18.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:19.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:19.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:19.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:19.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:20.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:20.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:20.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:20.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:21.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:21.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:21.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:21.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:22.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:22.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:22.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:22.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:23.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:23.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:23.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:23.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:24.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:24.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:24.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:24.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:25.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:25.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:25.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:25.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:26.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:26.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:26.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:26.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:27.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:27.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:27.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:27.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:28.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:28.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:28.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:28.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:29.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:29.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:29.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:29.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:30.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:30.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:30.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:30.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:31.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:31.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:31.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:31.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:32.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:32.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:32.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:32.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:33.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:33.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:33.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:33.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:34.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:34.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:34.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:34.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:35.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:35.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:35.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:35.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:36.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:36.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:36.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:36.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:37.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:37.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:37.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:37.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:38.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:38.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:38.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:38.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:39.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:39.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:39.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:39.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:40.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:40.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:40.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:40.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:41.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:41.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:41.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:41.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:42.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:42.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:42.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:42.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:43.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:43.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:43.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:43.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:44.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:44.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:44.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:44.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 48 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:45.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:45.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:45.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:45.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:46.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:46.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:46.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:46.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:47.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:47.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:47.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:47.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:48.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:48.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:48.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:48.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:49.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:49.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:49.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:49.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:50.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:50.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:50.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:50.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:51.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:51.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:51.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:51.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:52.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:52.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:52.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:52.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:53.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:53.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:53.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:53.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:54.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:54.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:54.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:54.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:55.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:55.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:55.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:55.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:56.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:56.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:56.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:56.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:57.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:57.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:57.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:57.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:58.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:58.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:58.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:58.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:59.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:06:59.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:06:59.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:06:59.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:06:59.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:00.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:00.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:00.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:00.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:01.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:01.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:01.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:02.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:02.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:02.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:02.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:02.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:02.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:03.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:03.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:03.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:03.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:04.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:04.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:04.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:04.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:05.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:05.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:05.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:05.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:06.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:06.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:07.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:07.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:07.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:07.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:07.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:07.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:08.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:08.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:09.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:09.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:09.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:09.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:10.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:10.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:10.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:10.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:11.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:11.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:11.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:11.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:11.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:12.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:12.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:12.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:13.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:13.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:13.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:13.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:14.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:14.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:14.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:14.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:07:15.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:15.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:15.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:15.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:16.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:16.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:16.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:16.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:17.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:17.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:17.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:17.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:18.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:18.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:18.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:18.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:19.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:19.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:19.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:19.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:20.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:20.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:20.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:20.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:21.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:21.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:21.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:21.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:22.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:22.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:22.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:22.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:22.918 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T19:07:22.931+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac03be80 msgr2=0x7f81ac040dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T19:07:23.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:23.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:23.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:23.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:24.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:24.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:24.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:24.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:25.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:25.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:25.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:25.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:26.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:26.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:26.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:26.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:27.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:27.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:27.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:27.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:28.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:28.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:28.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:28.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:29.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:29.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:29.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:29.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:30.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:30.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:30.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:30.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:31.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:31.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:31.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:31.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:32.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:32.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:32.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:32.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:33.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:33.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:33.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:33.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:34.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:34.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:34.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:34.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:35.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:35.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:35.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:35.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:36.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:36.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:36.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:36.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:37.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:37.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:37.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:37.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:38.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:38.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:38.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:38.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:39.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:39.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:39.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:39.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:40.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:40.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:40.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:40.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:41.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:41.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:41.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:41.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:42.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:42.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:42.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:42.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:43.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:43.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:43.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:43.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:44.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:44.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:44.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:44.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:45.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:45.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:45.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:45.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:46.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:46.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:46.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:46.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:47.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:47.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:47.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:47.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:48.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:48.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:48.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:48.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:49.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:49.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:49.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:49.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:49.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:49.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:50.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:50.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:51.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:51.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:51.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:51.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:52.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:52.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:52.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:52.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:53.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:53.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:53.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:53.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:54.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:54.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:54.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:54.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:55.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:55.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:55.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:55.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:56.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:56.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:56.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:56.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:57.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:57.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:57.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:57.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:58.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:58.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:58.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:58.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:59.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:07:59.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:07:59.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:07:59.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:00.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:00.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:00.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:00.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:01.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:01.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:01.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:01.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:02.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:02.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:02.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:02.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:03.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:03.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:03.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:03.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:04.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:04.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:04.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:04.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:05.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:05.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:05.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:05.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:06.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:06.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:06.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:06.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:07.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:07.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:07.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:07.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:08.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:08.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:08.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:08.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:09.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:09.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:09.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:09.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:10.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:10.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:10.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:10.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:11.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:11.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:11.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:11.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:12.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:12.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:12.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:12.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:13.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:13.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:13.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:13.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:14.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:14.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:14.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:14.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:15.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:15.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:15.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:15.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:16.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:16.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:16.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:16.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:17.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:17.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:17.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:17.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:18.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:18.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:18.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:18.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:19.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:19.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:19.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:19.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:20.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:20.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:20.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:20.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:21.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:21.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:21.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:21.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:22.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:22.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:22.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:22.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:23.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:23.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:23.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:23.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:24.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:24.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:24.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:24.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:25.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:25.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:25.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:25.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:26.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:26.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:26.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:26.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:27.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:27.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:27.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:27.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:28.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:28.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:28.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:28.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:29.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:29.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:29.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:29.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:30.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:30.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:30.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:30.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:31.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:31.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:31.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:31.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:32.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:32.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:32.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:32.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:33.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:33.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:33.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:33.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:34.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:34.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:34.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:34.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:35.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:35.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:35.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:35.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:36.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:36.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:36.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:36.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:37.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:37.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:37.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:37.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:38.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:38.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:38.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:38.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:39.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:39.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:39.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:39.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:40.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:40.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:40.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:40.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:41.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:41.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:41.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:41.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:42.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:42.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:42.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:42.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:43.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:43.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:43.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:43.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:44.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:44.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:44.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:44.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:45.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:45.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:45.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:45.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:46.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:46.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:46.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:46.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:47.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:47.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:47.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:47.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:48.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:48.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:48.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:48.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:49.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:49.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:49.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:49.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:50.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:50.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:50.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:50.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:51.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:51.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:51.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:51.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:52.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:52.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:52.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:52.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:53.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:53.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:53.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:53.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:54.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:54.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:54.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:54.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:55.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:55.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:55.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:55.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:56.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:56.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:56.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:56.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:57.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:57.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:57.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:57.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:58.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:58.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:58.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:58.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:59.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:08:59.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:08:59.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:08:59.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:00.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:00.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:00.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:00.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:01.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:01.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:01.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:01.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:02.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:02.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:02.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:02.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:03.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:03.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:03.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:03.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:04.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:04.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:04.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:04.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:05.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:05.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:05.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:05.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:06.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:06.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:06.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:06.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:07.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:07.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:07.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:07.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:07.937 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T19:09:07.950+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac035cc0 msgr2=0x7f81ac0380a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T19:09:08.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:08.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:08.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:08.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:09.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:09.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:09.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:09.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:10.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:10.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:10.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:10.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:11.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:11.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:11.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:11.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:12.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:12.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:12.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:12.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:13.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:13.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:13.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:13.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:14.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:14.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:14.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:14.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:15.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:15.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:15.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:15.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:16.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:16.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:16.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:16.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:17.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:17.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:17.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:17.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:18.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:18.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:18.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:18.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:19.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:19.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:19.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:19.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:20.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:20.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:20.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:20.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:21.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:21.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:21.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:21.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:22.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:22.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:22.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:22.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:23.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:23.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:23.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:23.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:24.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:24.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:24.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:24.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:25.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:25.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:25.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:25.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:26.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:26.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:26.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:26.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:27.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:27.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:27.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:27.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:28.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:28.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:28.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:28.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:29.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:29.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:29.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:29.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:30.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:30.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:30.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:30.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:31.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:31.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:31.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:31.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:32.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:32.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:32.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:32.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:33.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:33.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:33.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:33.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:34.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:34.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:34.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:34.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:35.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:35.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:35.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:35.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:36.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:36.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:36.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:36.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:37.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:37.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:37.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:37.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:38.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:38.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:38.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:38.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:39.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:39.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:39.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:39.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:40.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:40.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:40.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:40.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:41.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:41.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:41.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:41.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:42.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:42.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:42.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:42.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:43.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:43.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:43.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:43.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:44.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:44.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:44.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:44.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:45.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:45.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:45.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:45.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:46.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:46.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:46.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:46.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:46.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:47.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:47.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:47.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:48.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:48.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:48.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:48.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:48.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:49.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:49.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:49.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:49.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:49.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:50.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:50.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:50.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:50.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:51.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:51.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:51.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:51.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:52.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:52.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:52.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:52.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:53.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:53.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:53.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:53.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:54.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:54.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:55.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:55.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:55.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:55.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:55.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:55.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:56.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:56.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:56.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:56.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:57.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:57.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:57.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:57.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:58.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:58.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:58.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:58.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:59.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:09:59.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:09:59.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:09:59.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:00.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:00.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:00.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:00.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:01.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:01.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:01.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:01.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:02.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:02.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:02.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:03.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:03.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:03.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:04.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:04.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:04.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:04.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:05.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:05.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:05.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:05.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:06.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:06.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:06.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:06.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:07.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:07.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:07.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:07.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:08.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:08.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:08.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:08.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:09.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:09.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:09.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:09.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:10.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:10.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:10.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:10.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:11.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:11.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:11.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:11.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:12.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:12.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:12.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:12.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:13.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:13.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:13.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:13.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:14.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:14.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:14.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:14.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:15.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:15.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:15.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:15.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:16.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:16.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:16.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:16.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:17.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:17.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:17.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:17.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:17.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:17.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:18.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:18.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:18.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:18.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:19.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:19.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:19.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:19.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:20.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:20.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:20.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:20.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:21.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:21.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:21.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:21.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:22.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:22.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:22.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:22.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:23.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:23.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:23.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:23.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:24.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:24.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:24.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:24.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:25.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:25.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:25.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:25.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:26.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:26.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:26.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:26.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:27.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:27.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:27.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:27.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:28.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:28.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:28.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:28.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:29.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:29.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:29.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:29.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:30.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:30.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:30.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:31.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:31.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:31.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:31.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:31.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:32.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:32.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:32.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:32.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:33.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:33.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:33.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:33.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:34.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:34.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:34.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:34.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:35.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:35.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:35.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:35.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:36.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:36.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:36.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:36.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:37.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:37.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:37.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:37.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:38.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:38.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:39.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:39.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:39.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:39.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:39.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:39.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:40.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:40.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:40.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:40.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:41.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:41.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:41.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:41.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:42.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:42.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:42.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:42.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:43.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:43.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:43.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:43.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:44.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:44.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:44.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:44.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:45.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:45.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:46.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:45.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:46.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:46.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:46.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:46.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:47.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:47.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:47.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:48.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:48.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:48.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:48.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:48.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:49.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:49.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:49.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:49.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:50.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:50.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:50.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:50.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:51.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:51.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:51.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:52.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:52.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:52.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:52.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:52.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:53.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:53.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:54.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:54.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:54.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:54.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:54.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:54.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:55.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:55.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:56.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:56.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:56.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:56.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:57.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:57.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:57.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:57.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:58.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:58.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:58.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:58.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:59.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:10:59.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:10:59.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:10:59.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:00.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:00.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:00.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:00.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:01.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:01.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:01.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:01.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:02.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:02.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:02.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:02.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:03.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:03.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:03.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:03.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:04.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:04.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:04.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:04.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:05.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:05.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:05.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:05.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:06.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:06.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:06.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:06.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:07.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:07.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:07.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:07.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:07.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:08.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:08.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:08.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:08.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:08.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:09.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:09.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:09.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:09.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:10.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:10.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:10.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:11.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:11.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:11.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:11.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:12.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:12.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:12.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:12.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:12.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:13.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:13.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:13.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:14.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:14.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:14.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:14.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:14.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:15.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:15.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:15.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:15.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:16.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:16.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:16.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:16.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:17.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:17.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:17.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:18.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:18.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:18.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:19.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:19.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:19.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:19.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:20.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:20.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:20.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:20.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:21.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:21.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:21.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:21.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:22.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:22.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:22.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:22.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:23.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:23.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:23.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:23.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:24.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:24.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:24.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:24.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:25.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:25.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:25.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:25.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:26.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:26.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:26.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:26.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:27.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:27.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:27.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:27.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:28.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:28.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:28.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:28.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:29.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:29.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:29.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:29.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:30.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:30.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:30.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:30.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:31.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:31.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:31.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:31.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:32.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:32.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:32.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:32.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:33.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:33.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:33.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:33.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:34.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:34.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:34.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:34.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:35.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:35.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:35.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:35.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:36.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:36.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:36.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:36.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:37.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:37.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:37.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:37.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:38.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:38.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:38.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:38.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:39.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:39.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:39.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:39.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:40.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:40.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:40.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:40.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:41.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:41.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:41.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:41.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:42.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:42.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:42.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:42.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:43.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:43.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:43.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:43.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:44.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:44.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:44.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:44.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:45.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:45.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:45.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:45.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:46.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:46.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:46.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:46.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:47.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:47.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:47.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:47.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:48.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:48.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:48.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:48.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:49.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:49.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:49.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:49.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:50.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:50.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:50.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:50.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:51.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:51.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:51.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:51.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:52.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:52.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:52.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:52.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:53.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:53.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:53.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:53.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:54.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:54.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:54.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:54.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:55.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:55.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:55.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:55.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:56.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:56.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:56.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:56.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:57.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:57.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:57.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:57.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:58.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:58.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:58.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:58.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:59.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:11:59.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:11:59.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:11:59.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:00.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:00.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:00.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:00.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:01.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:01.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:01.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:01.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:02.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:02.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:02.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:02.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:03.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:03.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:03.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:03.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:04.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:04.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:04.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:04.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:05.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:05.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:05.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:05.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:06.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:06.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:06.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:06.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:07.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:07.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:07.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:07.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:08.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:08.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:08.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:08.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:09.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:09.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:09.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:09.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:10.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:10.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:10.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:10.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:11.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:11.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:11.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:11.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:12.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:12.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:12.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:12.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:13.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:13.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:13.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:13.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:14.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:14.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:14.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:14.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:15.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:15.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:15.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:15.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:16.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:16.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:16.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:16.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:17.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:17.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:17.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:17.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:18.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:18.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:18.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:18.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:19.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:19.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:19.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:19.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:20.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:20.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:20.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:20.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:21.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:21.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:21.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:21.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:22.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:22.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:22.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:22.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:23.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:23.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:23.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:23.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:24.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:24.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:24.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:24.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:25.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:25.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:25.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:25.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:26.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:26.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:26.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:26.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:26.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:26.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:27.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:27.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:27.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:27.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:28.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:28.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:28.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:28.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:29.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:29.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:29.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:29.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:30.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:30.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:30.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:30.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:31.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:31.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:31.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:31.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:32.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:32.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:32.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:32.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:33.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:33.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:33.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:33.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:34.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:34.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:34.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:34.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:35.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:35.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:35.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:35.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:36.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:36.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:36.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:36.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:37.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:37.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:37.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:37.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:38.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:38.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:38.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:38.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:39.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:39.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:39.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:39.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:40.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:40.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:40.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:40.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:41.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:41.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:41.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:41.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:42.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:42.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:42.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:42.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:43.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:43.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:43.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:43.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:44.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:44.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:44.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:44.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:45.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:45.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:45.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:45.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:46.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:46.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:46.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:46.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:47.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:47.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:47.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:47.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:48.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:48.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:48.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:48.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:49.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:49.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:49.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:49.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:50.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:50.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:50.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:50.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:51.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:51.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:51.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:51.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:52.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:52.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:52.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:52.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:53.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:53.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:53.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:53.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:54.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:54.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:54.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:54.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:55.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:55.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:55.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:55.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:56.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:56.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:56.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:56.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:57.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:57.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:57.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:57.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:58.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:58.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:58.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:58.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:59.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:12:59.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:12:59.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:12:59.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:00.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:00.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:00.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:00.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:01.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:01.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:01.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:01.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:02.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:02.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:02.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:02.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:03.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:03.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:03.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:03.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:04.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:04.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:04.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:04.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:05.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:05.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:05.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:05.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:06.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:06.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:06.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:06.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:07.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:07.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:07.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:07.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:08.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:08.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:08.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:08.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:09.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:09.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:09.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:09.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:10.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:10.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:10.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:10.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:11.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:11.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:11.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:11.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:12.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:12.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:12.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:12.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:13.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:13.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:13.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:13.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:14.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:14.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:14.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:14.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:15.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:15.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:15.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:15.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:16.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:16.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:16.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:16.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:17.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:17.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:17.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:17.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:18.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:18.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:18.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:18.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:19.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:19.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:19.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:19.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:20.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:20.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:20.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:20.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:21.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:21.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:21.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:21.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:22.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:22.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:22.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:22.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:23.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:23.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:23.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:23.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:24.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:24.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:24.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:24.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:25.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:25.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:25.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:25.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:26.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:26.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:26.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:26.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:27.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:27.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:27.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:27.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:28.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:28.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:28.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:28.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:29.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:29.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:29.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:29.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:30.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:30.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:30.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:30.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:31.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:31.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:31.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:31.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:32.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:32.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:32.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:32.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:33.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:33.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:33.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:33.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:34.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:34.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:34.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:34.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:35.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:35.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:35.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:35.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:36.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:36.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:36.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:36.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:37.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:37.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:37.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:37.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:38.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:38.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:38.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:38.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:39.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:39.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:39.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:39.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:40.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:40.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:40.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:40.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:41.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:41.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:41.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:41.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:42.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:42.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:42.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:42.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:43.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:43.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:43.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:43.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:44.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:44.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:44.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:44.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:45.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:45.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:45.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:45.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:46.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:46.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:46.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:46.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:47.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:47.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:47.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:47.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:48.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:48.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:48.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:48.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:49.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:49.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:49.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:49.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:50.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:50.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:50.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:50.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:51.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:51.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:51.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:51.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:52.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:52.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:52.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:52.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:53.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:53.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:53.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:53.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:54.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:54.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:54.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:54.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:55.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:55.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:55.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:55.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:56.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:56.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:56.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:56.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:57.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:57.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:57.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:57.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:58.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:58.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:58.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:58.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:59.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:13:59.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:13:59.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:13:59.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:00.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:00.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:00.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:00.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:01.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:01.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:01.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:01.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:02.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:02.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:02.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:02.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:03.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:03.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:03.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:03.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:04.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:04.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:04.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:04.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:05.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:05.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:05.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:05.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:06.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:06.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:06.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:06.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:07.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:07.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:07.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:07.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:08.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:08.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:08.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:08.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:09.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:09.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:09.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:09.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:10.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:10.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:10.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:10.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:11.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:11.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:11.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:11.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:12.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:12.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:12.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:12.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:13.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:13.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:13.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:13.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:14.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:14.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:14.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:14.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:15.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:15.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:15.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:15.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:16.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:16.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:16.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:16.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:17.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:17.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:17.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:17.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:18.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:18.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:18.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:18.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:19.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:19.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:19.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:19.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:20.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:20.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:20.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:20.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:21.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:21.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:21.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:21.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:22.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:22.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:22.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:22.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:23.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:23.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:23.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:23.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:24.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:24.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:24.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:24.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:25.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:25.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:25.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:25.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:26.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:26.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:26.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:26.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:27.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:27.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:27.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:27.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:28.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:28.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:28.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:28.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:29.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:29.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:29.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:29.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:30.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:30.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:30.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:30.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:31.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:31.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:31.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:31.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:32.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:32.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:32.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:32.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:33.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:33.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:33.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:33.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:34.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:34.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:34.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:34.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:35.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:35.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:35.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:35.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:36.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:36.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:36.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:36.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:37.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:37.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:37.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:37.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:38.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:38.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:38.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:38.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:39.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:39.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:39.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:39.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:40.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:40.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:40.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:40.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:41.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:41.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:41.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:41.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:42.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:42.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:42.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:42.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:43.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:43.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:43.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:43.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:44.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:44.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:44.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:44.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:45.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:45.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:45.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:45.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:46.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:46.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:46.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:46.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:47.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:47.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:47.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:47.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:48.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:48.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:48.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:48.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:49.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:49.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:49.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:49.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:50.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:50.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:50.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:50.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:51.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:51.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:51.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:51.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:52.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:52.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:52.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:52.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:53.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:53.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:53.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:53.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:54.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:54.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:54.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:54.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:55.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:55.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:55.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:55.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:56.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:56.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:56.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:56.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:57.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:57.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:57.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:57.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:58.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:58.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:58.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:58.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:59.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:14:59.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:14:59.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:14:59.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:00.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:00.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:00.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:00.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:01.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:01.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:01.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:01.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:02.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:02.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:02.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:02.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:03.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:03.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:03.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:03.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:04.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:04.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:04.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:04.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:05.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:05.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:05.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:05.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:06.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:06.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:06.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:06.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:07.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:07.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:07.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:07.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:08.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:08.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:08.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:08.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:09.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:09.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:09.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:09.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:10.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:10.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:10.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:10.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:11.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:11.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:11.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:11.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:12.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:12.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:12.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:12.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:13.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:13.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:13.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:13.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:14.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:14.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:14.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:14.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:15.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:15.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:15.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:15.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:16.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:16.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:16.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:16.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:17.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:17.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:17.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:17.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:18.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:18.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:18.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:18.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:19.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:19.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:19.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:19.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:20.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:20.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:20.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:20.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:21.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:21.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:21.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:21.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:22.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:22.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:22.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:22.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:23.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:23.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:23.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:23.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:24.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:24.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:24.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:24.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:25.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:25.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:25.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:25.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:26.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:26.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:26.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:26.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:27.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:27.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:27.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:27.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:28.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:28.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:28.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:28.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:29.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:29.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:29.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:29.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:30.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:30.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:30.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:30.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:31.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:31.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:31.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:31.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:32.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:32.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:32.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:32.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:33.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:33.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:33.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:33.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:34.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:34.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:34.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:34.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:35.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:35.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:35.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:35.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:36.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:36.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:36.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:36.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:37.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:37.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:37.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:37.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:38.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:38.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:38.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:38.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:39.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:39.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:39.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:39.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:40.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:40.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:40.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:40.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:41.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:41.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:41.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:41.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:42.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:42.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:42.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:42.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:43.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:43.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:43.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:43.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:44.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:44.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:44.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:44.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:45.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:45.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:45.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:45.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:46.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:46.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:46.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:46.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:47.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:47.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:47.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:47.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:48.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:48.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:48.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:48.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:49.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:49.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:49.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:49.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:50.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:50.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:50.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:50.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:51.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:51.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:51.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:51.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:52.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:52.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:52.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:52.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:53.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:53.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:53.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:53.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:54.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:54.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:54.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:54.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:55.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:55.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:55.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:55.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:56.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:56.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:56.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:56.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:57.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:57.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:57.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:57.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:58.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:58.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:58.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:58.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:59.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:15:59.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:15:59.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:15:59.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:00.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:00.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:00.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:00.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:01.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:01.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:01.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:01.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:02.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:02.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:02.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:02.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:03.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:03.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:03.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:03.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:04.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:04.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:04.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:04.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:05.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:05.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:05.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:05.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:06.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:06.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:06.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:06.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:07.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:07.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:07.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:07.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:08.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:08.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:08.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:08.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:09.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:09.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:09.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:09.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:10.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:10.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:10.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:10.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:11.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:11.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:11.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:11.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:12.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:12.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:12.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:12.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:13.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:13.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:13.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:13.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:14.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:14.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:14.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:14.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:15.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:15.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:15.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:15.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:16.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:16.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:16.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:16.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:17.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:17.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:17.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:17.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:18.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:18.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:18.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:18.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:19.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:19.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:19.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:19.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:20.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:20.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:20.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:20.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:21.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:21.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:21.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:21.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:22.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:22.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:22.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:22.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:23.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:23.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:23.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:23.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:24.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:24.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:24.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:24.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:25.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:25.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:25.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:25.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:26.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:26.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:26.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:26.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:27.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:27.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:27.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:27.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:28.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:28.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:28.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:28.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:29.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:29.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:29.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:29.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:30.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:30.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:30.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:30.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:31.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:31.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:31.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:31.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:32.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:32.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:32.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:32.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:33.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:33.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:33.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:33.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:34.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:34.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:34.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:34.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:35.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:35.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:35.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:35.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:36.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:36.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:36.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:36.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:37.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:37.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:37.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:37.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:38.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:38.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:38.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:38.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:39.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:39.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:39.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:39.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:40.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:40.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:40.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:40.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:41.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:41.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:41.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:41.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:42.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:42.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:42.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:42.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:43.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:43.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:43.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:43.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:44.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:44.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:44.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:44.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:45.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:45.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:45.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:45.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:46.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:46.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:46.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:46.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:47.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:47.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:47.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:47.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:48.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:48.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:48.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:48.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:49.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:49.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:49.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:49.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:50.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:50.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:50.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:50.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:51.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:51.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:51.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:51.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:52.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:52.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:52.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:52.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:53.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:53.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:53.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:53.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:54.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:54.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:54.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:54.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:55.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:55.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:55.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:55.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:56.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:56.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:56.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:56.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:57.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:57.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:57.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:57.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:58.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:58.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:58.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:58.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:59.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:16:59.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:16:59.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:16:59.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:00.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:00.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:00.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:00.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:01.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:01.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:01.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:01.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:02.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:02.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:02.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:02.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:03.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:03.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:03.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:03.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:04.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:04.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:04.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:04.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:05.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:05.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:05.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:05.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:06.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:06.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:06.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:06.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:07.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:07.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:07.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:07.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:08.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:08.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:08.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:08.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:09.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:09.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:09.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:09.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:10.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:10.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:10.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:10.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:11.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:11.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:11.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:11.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:12.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:12.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:12.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:12.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:13.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:13.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:13.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:13.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:14.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:14.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:14.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:14.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:15.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:15.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:15.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:15.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:16.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:16.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:16.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:16.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:17.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:17.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:17.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:17.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:18.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:18.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:18.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:18.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:19.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:19.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:19.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:19.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:20.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:20.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:20.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:20.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:21.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:21.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:21.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:21.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:22.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:22.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:22.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:22.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:23.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:23.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:23.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:23.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:24.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:24.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:24.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:24.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:25.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:25.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:25.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:25.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:26.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:26.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:26.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:26.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:27.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:27.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:27.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:27.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:28.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:28.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:28.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:28.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:29.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:29.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:29.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:29.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:30.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:30.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:30.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:30.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:31.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:31.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:31.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:31.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:32.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:32.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:32.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:32.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:33.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:33.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:33.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:33.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:34.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:34.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:34.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:34.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:35.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:35.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:35.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:35.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:36.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:36.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:36.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:36.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:37.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:37.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:37.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:37.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:38.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:38.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:38.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:38.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:39.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:39.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:39.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:39.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:40.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:40.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:40.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:40.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:41.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:41.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:41.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:41.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:42.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:42.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:42.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:42.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:43.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:43.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:43.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:43.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:44.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:44.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:44.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:44.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:45.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:45.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:45.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:45.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:46.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:46.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:46.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:46.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:47.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:47.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:47.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:47.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:48.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:48.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:48.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:48.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:49.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:49.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:49.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:49.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:50.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:50.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:50.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:50.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:51.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:51.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:51.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:51.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:52.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:52.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:52.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:52.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:53.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:53.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:53.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:53.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:54.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:54.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:54.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:54.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:55.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:55.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:55.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:55.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:56.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:56.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:56.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:56.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:57.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:57.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:57.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:57.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:58.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:58.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:58.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:58.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:59.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:17:59.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:17:59.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:17:59.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:00.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:00.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:00.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:00.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:01.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:01.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:01.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:01.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:02.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:02.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:02.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:02.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:03.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:03.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:03.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:03.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:04.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:04.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:04.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:04.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:05.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:05.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:05.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:05.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:06.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:06.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:06.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:06.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:07.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:07.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:07.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:07.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:08.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:08.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:08.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:08.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:09.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:09.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:09.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:09.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:10.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:10.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:10.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:10.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:11.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:11.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:11.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:11.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:12.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:12.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:12.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:12.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:13.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:13.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:13.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:13.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:14.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:14.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:14.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:14.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:15.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:15.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:15.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:15.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:16.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:16.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:16.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:16.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:17.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:17.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:17.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:17.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:18.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:18.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:18.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:18.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:19.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:19.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:19.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:19.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:20.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:20.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:20.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:20.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:21.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:21.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:21.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:21.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:22.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:22.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:22.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:22.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:23.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:23.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:23.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:23.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:24.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:24.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:24.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:24.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:25.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:25.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:25.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:25.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:26.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:26.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:26.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:26.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:27.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:27.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:27.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:27.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:28.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:28.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:28.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:28.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:29.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:29.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:29.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:29.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:30.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:30.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:30.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:30.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:31.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:31.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:31.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:31.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:32.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:32.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:32.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:32.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:33.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:33.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:33.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:33.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:34.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:34.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:34.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:34.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:35.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:35.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:35.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:35.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:36.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:36.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:36.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:36.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:37.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:37.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:37.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:37.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:38.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:38.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:38.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:38.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:39.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:39.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:39.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:39.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:40.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:40.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:40.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:40.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:41.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:41.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:41.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:41.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:42.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:42.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:42.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:42.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:43.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:43.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:43.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:43.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:44.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:44.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:44.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:44.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:45.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:45.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:45.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:45.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:46.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:46.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:46.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:46.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:47.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:47.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:47.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:47.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:48.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:48.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:48.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:48.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:49.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:49.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:49.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:49.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:50.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:50.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:50.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:50.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:51.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:51.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:51.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:51.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:52.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:52.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:52.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:52.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:53.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:53.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:53.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:53.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:54.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:54.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:54.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:54.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:55.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:55.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:55.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:55.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:56.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:56.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:56.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:56.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:57.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:57.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:57.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:57.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:58.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:58.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:58.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:58.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:59.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:18:59.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:18:59.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:18:59.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:00.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:00.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:00.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:00.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:01.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:01.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:01.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:01.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:02.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:02.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:02.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:02.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:03.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:03.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:03.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:03.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:04.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:04.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:04.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:04.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:05.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:05.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:05.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:05.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:06.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:06.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:06.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:06.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:07.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:07.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:07.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:07.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:08.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:08.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:08.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:08.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:09.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:09.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:09.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:09.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:10.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:10.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:10.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:10.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:11.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:11.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:11.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:11.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:12.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:12.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:12.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:12.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:13.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:13.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:13.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:13.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:14.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:14.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:14.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:14.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:15.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:15.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:15.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:15.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:16.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:16.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:16.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:16.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:17.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:17.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:17.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:17.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:18.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:18.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:18.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:18.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:19.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:19.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:19.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:19.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:20.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:20.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:20.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:20.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:21.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:21.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:21.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:21.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:22.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:22.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:22.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:22.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:23.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:23.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:23.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:23.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:24.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:24.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:24.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:24.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:25.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:25.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:25.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:25.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:26.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:26.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:26.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:26.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:27.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:27.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:27.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:27.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:28.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:28.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:28.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:28.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:29.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:29.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:29.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:29.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:30.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:30.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:30.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:30.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:31.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:31.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:31.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:31.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:32.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:32.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:32.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:32.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:33.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:33.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:33.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:33.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:34.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:34.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:34.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:34.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:35.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:35.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:35.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:35.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:36.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:36.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:36.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:36.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:37.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:37.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:37.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:37.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:38.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:38.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:38.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:38.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:39.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:39.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:39.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:39.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:40.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:40.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:40.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:40.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:41.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:41.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:41.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:41.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:42.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:42.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:42.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:42.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:43.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:43.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:43.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:43.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:44.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:44.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:44.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:44.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:45.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:45.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:45.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:45.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:46.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:46.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:46.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:46.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:47.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:47.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:47.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:47.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:48.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:48.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:48.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:48.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:49.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:49.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:49.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:49.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:50.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:50.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:50.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:50.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:51.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:51.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:51.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:51.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:52.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:52.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:52.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:52.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:53.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:53.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:53.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:53.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:54.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:54.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:54.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:54.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:55.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:55.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:55.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:55.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:56.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:56.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:56.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:56.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:57.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:57.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:57.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:57.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:58.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:58.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:58.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:58.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:59.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:19:59.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:19:59.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:19:59.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:00.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:00.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:01.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:01.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:01.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:01.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:02.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:02.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:02.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:02.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:03.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:03.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:03.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:03.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:04.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:04.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:04.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:04.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:05.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:05.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:05.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:05.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:06.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:06.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:06.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:06.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:07.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:07.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:07.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:07.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:08.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:08.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:08.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:08.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:09.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:09.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:09.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:09.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:10.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:10.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:10.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:10.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:11.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:11.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:11.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:11.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:12.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:12.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:12.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:12.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:13.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:13.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:13.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:13.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:14.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:14.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:14.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:14.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:15.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:15.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:15.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:15.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:16.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:16.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:16.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:16.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:17.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:17.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:17.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:17.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:18.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:18.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:18.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:18.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:19.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:19.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:19.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:19.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:20.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:20.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:20.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:20.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:21.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:21.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:21.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:21.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:22.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:22.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:22.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:22.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:23.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:23.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:23.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:23.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:24.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:24.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:24.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:24.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:25.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:25.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:25.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:25.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:26.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:26.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:26.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:26.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:27.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:27.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:27.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:27.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:28.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:28.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:28.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:28.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:29.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:29.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:29.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:29.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:30.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:30.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:30.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:30.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:31.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:31.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:31.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:31.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:32.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:32.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:32.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:32.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:33.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:33.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:33.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:33.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:34.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:34.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:34.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:34.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:35.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:35.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:35.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:35.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:36.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:36.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:36.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:36.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:37.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:37.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:37.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:37.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:38.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:38.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:38.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:38.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:39.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:39.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:39.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:39.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:40.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:40.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:40.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:40.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:41.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:41.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:41.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:41.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:42.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:42.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:42.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:42.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:43.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:43.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:43.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:43.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:44.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:44.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:44.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:44.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:45.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:45.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:45.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:45.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:46.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:46.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:46.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:46.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:47.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:47.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:47.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:47.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:48.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:48.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:48.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:48.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:49.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:49.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:49.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:49.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:50.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:50.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:50.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:50.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:51.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:51.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:51.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:51.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:52.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:52.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:52.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:52.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:53.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:53.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:53.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:53.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:54.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:54.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:54.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:54.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:55.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:55.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:55.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:55.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:56.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:56.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:56.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:56.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:57.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:57.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:57.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:57.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:58.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:58.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:58.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:58.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:59.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:20:59.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:20:59.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:20:59.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:00.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:00.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:00.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:00.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:01.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:01.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:01.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:01.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:02.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:02.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:02.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:02.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:03.070 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T19:21:03.084+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac03be80 msgr2=0x7f81ac040dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T19:21:03.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:03.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:03.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:03.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:04.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:04.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:04.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:04.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:05.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:05.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:05.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:05.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:06.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:06.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:06.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:06.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:07.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:07.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:07.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:07.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:08.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:08.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:08.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:08.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:09.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:09.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:09.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:09.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:10.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:10.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:10.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:10.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:11.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:11.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:11.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:11.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:12.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:12.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:12.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:12.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:13.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:13.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:13.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:13.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:14.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:14.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:14.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:14.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:15.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:15.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:15.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:15.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:16.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:16.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:16.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:16.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:17.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:17.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:17.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:17.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:18.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:18.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:18.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:18.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:19.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:19.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:19.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:19.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:20.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:20.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:20.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:20.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:21.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:21.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:21.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:21.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:22.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:22.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:22.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:22.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:23.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:23.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:23.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:23.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:24.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:24.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:24.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:24.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:25.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:25.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:25.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:25.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:26.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:26.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:26.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:26.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:27.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:27.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:27.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:27.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:28.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:28.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:28.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:28.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:29.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:29.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:29.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:29.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:30.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:30.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:30.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:30.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:31.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:31.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:31.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:31.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:32.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:32.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:32.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:32.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:33.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:33.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:33.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:33.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:34.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:34.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:34.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:34.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:35.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:35.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:35.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:35.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:36.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:36.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:36.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:36.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:37.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:37.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:37.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:37.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:38.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:38.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:38.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:38.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:39.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:39.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:39.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:39.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:40.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:40.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:40.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:40.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:41.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:41.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:41.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:41.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:42.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:42.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:42.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:42.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:43.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:43.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:43.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:43.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:44.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:44.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:44.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:44.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 51 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:45.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:45.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:45.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:45.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:46.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:46.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:46.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:46.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:47.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:47.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:47.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:47.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:48.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:48.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:48.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:48.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:49.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:49.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:49.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:49.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:50.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:50.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:50.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:50.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:51.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:51.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:51.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:51.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:52.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:52.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:52.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:52.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:53.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:53.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:53.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:53.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:54.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:54.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:54.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:54.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:55.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:55.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:55.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:55.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:56.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:56.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:56.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:56.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:57.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:57.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:57.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:57.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:58.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:58.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:58.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:58.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:59.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:21:59.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:21:59.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:21:59.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:00.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:00.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:00.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:00.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:01.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:01.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:01.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:01.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:02.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:02.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:02.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:02.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:03.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:03.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:03.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:03.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:04.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:04.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:04.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:04.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:05.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:05.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:05.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:05.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:06.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:06.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:06.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:06.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:07.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:07.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:07.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:07.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:08.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:08.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:08.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:08.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:09.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:09.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:09.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:09.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:10.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:10.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:10.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:10.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:11.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:11.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:11.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:11.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:12.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:12.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:12.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:12.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:13.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:13.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:13.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:13.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:14.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:14.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:14.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:14.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 41 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:15.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:15.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:15.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:15.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:16.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:16.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:16.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:16.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:17.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:17.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:17.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:17.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:18.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:18.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:18.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:18.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:19.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:19.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:19.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:19.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:20.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:20.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:20.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:20.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:21.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:21.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:21.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:21.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:22.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:22.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:22.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:22.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:23.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:23.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:23.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:23.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:24.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:24.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:24.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:24.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:25.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:25.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:25.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:25.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:26.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:26.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:26.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:26.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:27.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:27.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:27.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:27.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:28.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:28.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:28.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:28.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:29.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:29.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:29.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:29.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:30.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:30.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:30.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:30.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:31.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:31.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:31.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:31.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:32.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:32.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:32.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:32.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:33.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:33.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:33.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:33.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:34.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:34.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:34.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:34.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:35.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:35.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:35.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:35.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:36.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:36.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:36.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:36.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:37.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:37.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:37.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:37.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:38.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:38.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:38.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:38.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:39.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:39.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:39.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:39.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:40.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:40.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:40.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:40.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:41.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:41.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:41.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:41.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:42.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:42.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:42.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:42.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:43.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:43.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:43.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:43.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:44.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:44.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:44.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:44.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:45.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:45.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:45.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:45.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:46.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:46.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:46.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:46.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:47.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:47.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:47.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:47.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:48.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:48.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:48.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:48.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:49.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:49.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:49.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:49.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:50.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:50.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:50.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:50.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:51.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:51.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:51.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:51.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:52.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:52.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:52.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:52.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:53.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:53.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:53.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:53.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:54.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:54.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:54.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:54.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:55.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:55.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:55.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:55.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:56.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:56.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:56.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:56.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:57.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:57.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:57.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:57.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:58.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:58.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:58.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:58.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:59.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:22:59.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:22:59.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:22:59.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:00.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:00.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:00.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:00.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:01.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:01.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:01.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:01.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:02.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:02.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:02.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:02.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:03.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:03.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:03.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:03.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:04.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:04.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:04.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:04.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:05.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:05.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:05.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:05.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:06.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:06.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:06.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:06.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:07.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:07.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:07.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:07.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:08.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:08.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:08.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:08.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:09.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:09.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:09.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:09.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:10.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:10.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:10.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:10.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:11.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:11.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:11.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:11.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:12.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:12.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:12.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:12.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:13.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:13.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:13.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:13.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:14.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:14.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:14.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:14.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:15.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:15.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:15.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:15.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:16.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:16.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:16.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:16.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:17.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:17.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:17.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:17.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:18.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:18.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:18.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:18.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:19.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:19.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:19.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:19.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:20.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:20.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:20.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:20.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:21.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:21.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:21.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:21.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:22.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:22.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:22.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:22.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:23.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:23.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:23.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:23.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:24.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:24.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:24.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:24.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:25.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:25.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:25.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:25.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:26.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:26.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:26.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:26.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:27.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:27.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:27.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:27.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:28.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:28.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:28.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:28.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:29.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:29.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:29.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:29.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:30.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:30.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:30.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:30.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:31.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:31.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:31.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:31.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:32.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:32.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:32.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:32.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:33.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:33.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:33.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:33.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:34.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:34.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:34.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:34.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:35.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:35.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:35.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:35.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:36.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:36.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:36.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:36.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:37.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:37.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:37.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:37.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:38.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:38.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:38.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:38.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:39.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:39.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:39.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:39.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:40.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:40.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:40.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:40.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:41.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:41.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:41.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:41.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:42.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:42.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:42.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:42.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:43.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:43.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:43.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:43.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:44.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:44.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:44.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:44.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:45.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:45.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:45.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:45.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:46.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:46.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:46.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:46.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:47.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:47.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:47.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:47.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:48.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:48.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:48.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:48.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:49.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:49.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:49.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:49.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:50.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:50.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:50.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:50.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:51.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:51.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:51.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:51.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:52.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:52.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:52.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:52.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:53.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:53.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:53.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:53.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:54.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:54.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:54.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:54.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:55.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:55.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:55.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:55.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:56.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:56.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:56.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:56.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:57.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:57.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:57.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:57.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:58.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:58.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:58.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:58.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:59.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:23:59.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:23:59.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:23:59.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:00.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:00.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:00.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:00.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:01.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:01.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:01.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:01.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:02.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:02.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:02.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:02.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:03.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:03.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:03.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:03.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:04.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:04.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:04.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:04.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:05.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:05.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:05.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:05.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:06.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:06.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:06.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:06.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:07.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:07.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:07.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:07.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:08.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:08.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:08.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:08.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:09.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:09.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:09.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:09.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:10.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:10.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:10.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:10.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:11.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:11.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:11.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:11.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:12.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:12.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:12.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:12.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:13.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:13.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:13.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:13.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:14.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:14.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:14.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:14.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:15.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:15.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:15.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:15.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:16.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:16.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:16.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:16.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:17.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:17.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:17.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:17.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:18.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:18.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:18.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:18.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:19.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:19.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:19.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:19.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:20.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:20.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:20.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:20.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:21.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:21.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:21.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:21.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:22.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:22.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:22.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:22.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:23.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:23.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:23.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:23.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:24.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:24.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:24.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:24.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:24.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:25.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:25.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:25.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:25.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:26.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:26.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:26.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:26.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:26.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:27.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:27.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:27.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:27.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:28.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:28.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:28.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:28.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:29.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:29.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:30.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:30.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:30.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:30.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:31.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:31.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:31.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:31.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:32.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:32.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:32.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:32.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:33.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:33.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:33.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:33.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:34.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:34.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:34.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:34.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:35.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:35.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:35.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:35.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:36.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:36.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:36.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:36.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:37.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:37.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:37.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:37.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:38.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:38.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:38.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:38.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:39.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:39.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:39.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:39.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:40.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:40.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:40.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:40.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:41.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:41.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:41.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:41.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:42.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:42.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:42.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:42.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:43.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:43.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:43.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:43.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:44.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:44.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:44.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:44.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:45.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:45.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:45.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:45.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:46.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:46.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:46.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:46.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:47.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:47.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:47.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:47.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:48.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:48.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:48.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:48.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:48.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:48.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:49.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:49.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:49.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:49.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:50.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:50.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:50.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:50.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:51.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:51.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:52.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:52.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:52.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:52.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:53.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:53.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:53.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:53.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:53.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:54.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:54.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:54.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:54.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:55.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:55.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:55.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:56.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:56.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:56.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:56.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:57.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:57.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:57.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:57.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:57.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:57.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:58.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:58.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:58.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:58.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:59.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:24:59.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:24:59.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:24:59.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:00.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:00.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:00.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:01.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:01.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:01.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:01.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:01.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:02.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:02.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:02.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:02.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:03.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:03.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:03.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:03.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:04.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:04.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:04.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:04.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:05.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:05.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:05.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:05.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:06.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:06.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:06.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:06.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:07.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:07.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:07.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:07.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:08.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:08.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:08.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:08.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:09.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:09.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:09.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:09.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:10.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:10.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:10.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:10.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:11.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:11.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:11.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:11.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:12.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:12.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:12.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:12.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:13.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:13.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:13.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:13.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:14.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:14.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:14.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:14.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:15.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:15.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:15.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:15.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:16.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:16.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:16.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:16.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:17.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:17.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:17.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:17.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:18.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:18.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:18.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:18.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:19.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:19.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:19.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:19.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:20.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:20.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:20.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:20.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:21.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:21.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:21.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:21.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:22.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:22.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:22.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:22.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:23.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:23.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:23.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:23.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:24.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:24.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:24.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:25.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:25.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:25.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:26.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:26.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:26.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:26.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:27.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:27.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:27.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:27.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:28.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:28.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:28.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:28.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:29.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:29.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:29.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:29.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:30.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:30.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:30.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:30.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:31.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:31.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:31.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:31.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:32.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:32.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:32.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:32.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:33.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:33.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:33.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:33.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:34.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:34.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:34.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:34.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:35.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:35.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:35.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:35.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:36.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:36.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:36.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:36.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:37.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:37.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:37.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:37.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:38.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:38.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:38.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:38.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:39.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:39.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:39.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:39.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:40.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:40.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:40.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:40.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:41.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:41.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:41.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:41.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:42.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:42.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:42.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:42.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:43.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:43.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:43.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:43.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:44.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:44.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:44.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:44.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:45.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:45.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:45.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:45.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:46.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:46.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:46.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:46.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:47.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:47.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:47.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:47.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:48.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:48.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:48.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:48.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:49.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:49.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:49.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:49.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:50.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:50.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:50.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:50.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:51.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:51.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:51.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:51.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:52.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:52.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:52.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:52.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:53.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:53.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:53.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:53.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:54.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:54.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:54.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:54.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:55.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:55.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:55.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:55.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:56.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:56.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:56.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:56.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:57.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:57.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:57.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:57.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:58.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:58.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:58.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:58.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:59.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:25:59.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:25:59.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:25:59.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:00.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:00.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:00.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:00.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:01.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:01.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:01.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:01.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:02.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:02.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:02.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:02.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:03.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:03.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:03.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:03.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:04.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:04.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:04.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:04.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:05.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:05.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:05.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:05.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:06.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:06.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:06.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:06.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:07.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:07.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:07.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:07.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:08.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:08.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:08.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:08.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:09.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:09.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:09.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:09.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:10.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:10.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:10.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:10.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:11.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:11.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:11.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:11.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:12.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:12.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:12.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:12.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:13.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:13.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:13.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:13.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:14.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:14.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:14.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:14.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:15.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:15.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:15.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:15.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:16.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:16.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:16.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:16.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:17.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:17.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:17.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:17.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:18.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:18.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:18.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:18.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:19.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:19.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:19.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:19.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:20.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:20.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:20.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:20.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:21.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:21.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:21.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:21.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:22.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:22.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:22.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:22.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:23.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:23.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:23.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:23.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:24.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:24.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:24.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:24.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:25.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:25.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:25.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:25.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:26.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:26.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:26.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:26.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:27.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:27.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:27.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:27.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:28.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:28.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:28.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:28.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:29.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:29.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:29.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:29.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:30.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:30.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:30.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:30.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:31.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:31.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:31.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:31.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:32.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:32.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:32.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:32.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:33.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:33.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:33.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:33.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:34.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:34.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:34.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:34.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:35.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:35.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:35.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:35.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:36.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:36.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:36.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:36.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:37.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:37.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:37.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:37.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:38.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:38.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:38.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:38.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:39.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:39.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:39.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:39.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:40.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:40.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:40.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:40.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:41.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:41.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:41.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:41.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:42.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:42.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:42.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:42.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:43.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:43.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:43.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:43.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:44.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:44.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:44.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:44.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:45.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:45.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:45.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:45.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:46.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:46.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:46.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:46.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:47.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:47.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:47.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:47.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:48.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:48.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:48.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:48.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:49.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:49.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:49.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:49.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:50.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:50.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:50.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:50.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:51.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:51.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:51.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:51.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:52.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:52.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:52.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:52.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:53.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:53.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:53.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:53.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:54.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:54.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:54.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:54.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:55.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:55.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:55.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:55.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:56.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:56.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:56.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:56.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:57.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:57.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:57.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:57.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:58.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:58.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:58.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:58.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:59.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:26:59.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:26:59.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:26:59.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:00.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:00.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:00.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:00.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:01.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:01.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:01.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:01.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:02.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:02.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:02.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:02.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:03.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:03.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:03.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:03.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:04.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:04.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:04.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:04.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:05.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:05.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:05.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:05.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:06.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:06.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:06.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:06.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:07.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:07.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:07.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:07.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:08.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:08.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:08.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:08.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:09.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:09.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:09.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:09.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:10.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:10.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:10.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:10.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:11.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:11.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:11.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:11.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:12.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:12.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:12.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:12.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:13.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:13.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:13.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:13.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:14.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:14.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:14.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:14.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:15.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:15.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:15.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:15.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:16.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:16.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:16.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:16.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:17.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:17.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:17.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:17.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:18.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:18.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:18.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:18.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:19.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:19.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:19.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:19.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:20.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:20.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:20.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:20.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:21.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:21.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:21.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:21.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:22.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:22.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:22.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:22.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:23.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:23.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:23.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:23.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:24.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:24.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:24.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:24.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:25.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:25.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:25.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:25.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:26.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:26.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:26.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:26.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:27.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:27.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:27.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:27.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:28.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:28.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:28.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:28.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:29.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:29.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:29.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:29.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:30.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:30.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:30.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:30.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:31.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:31.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:31.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:31.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:32.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:32.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:32.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:32.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:33.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:33.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:33.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:33.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:34.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:34.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:34.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:34.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:35.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:35.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:35.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:35.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:36.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:36.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:36.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:36.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:37.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:37.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:37.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:37.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:38.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:38.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:38.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:38.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:39.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:39.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:39.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:39.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:40.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:40.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:40.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:40.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:41.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:41.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:41.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:41.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:42.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:42.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:42.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:42.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:43.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:43.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:43.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:43.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:44.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:44.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:44.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:44.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:45.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:45.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:45.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:45.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:46.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:46.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:46.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:46.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:47.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:47.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:47.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:47.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:48.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:48.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:48.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:48.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:49.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:49.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:49.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:49.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:50.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:50.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:50.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:50.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:51.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:51.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:51.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:51.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:52.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:52.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:52.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:52.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:53.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:53.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:53.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:53.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:54.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:54.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:54.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:54.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:55.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:55.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:55.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:55.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:56.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:56.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:56.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:56.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:57.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:57.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:57.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:57.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:58.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:58.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:58.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:58.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:59.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:27:59.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:27:59.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:27:59.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:00.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:00.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:00.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:00.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:01.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:01.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:01.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:01.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:02.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:02.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:02.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:02.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:03.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:03.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:03.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:03.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:03.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:03.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:04.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:04.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:04.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:04.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:05.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:05.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:05.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:06.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:06.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:06.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:07.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:07.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:07.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:07.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:08.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:08.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:08.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:08.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:09.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:09.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:09.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:09.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:10.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:10.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:10.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:11.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:10.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:11.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:11.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:11.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:11.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:12.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:12.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:12.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:13.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:13.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:13.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:13.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:14.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:14.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:14.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:14.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:15.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:15.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:15.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:15.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:16.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:16.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:16.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:16.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:17.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:17.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:17.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:17.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:18.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:18.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:18.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:18.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:19.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:19.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:19.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:19.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:20.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:20.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:20.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:20.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:21.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:21.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:21.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:21.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:22.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:22.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:22.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:22.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:23.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:23.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:23.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:24.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:24.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:24.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:25.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:25.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:25.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:25.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:26.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:26.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:26.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:26.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:27.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:27.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:27.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:27.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:28.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:28.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:28.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:28.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:29.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:29.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:29.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:29.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:30.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:30.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:30.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:30.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:30.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:31.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:31.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:31.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:31.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:32.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:32.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:32.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:32.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:32.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:33.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:33.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:33.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:33.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:34.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:34.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:34.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:35.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:35.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:35.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:36.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:36.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:36.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:36.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:37.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:37.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:37.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:37.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:38.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:38.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:38.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:38.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:39.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:39.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:39.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:39.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:40.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:40.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:40.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:40.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:41.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:41.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:41.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:41.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:42.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:42.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:42.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:42.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:43.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:43.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:43.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:43.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:43.156 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T19:28:43.171+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81a8004bb0 msgr2=0x7f81ac053db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T19:28:44.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:44.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:44.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:44.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:45.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:45.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:45.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:45.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:46.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:46.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:46.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:46.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:46.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:47.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:47.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:47.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:47.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:48.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:48.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:48.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:48.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:49.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:48.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:49.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:50.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:50.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:50.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:50.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:50.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:50.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:51.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:51.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:51.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:51.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:52.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:52.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:52.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:52.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:53.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:53.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:53.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:53.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:54.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:54.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:54.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:54.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:55.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:55.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:55.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:55.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:56.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:56.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:56.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:56.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:57.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:57.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:57.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:57.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:58.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:58.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:58.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:58.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:59.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:28:59.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:28:59.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:28:59.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:00.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:00.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:00.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:00.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:01.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:01.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:01.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:01.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:02.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:02.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:02.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:02.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:03.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:03.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:03.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:03.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:04.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:04.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:04.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:04.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:05.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:05.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:05.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:05.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:05.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:06.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:06.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:06.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:06.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:06.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:07.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:07.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:07.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:07.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:08.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:08.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:08.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:08.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:09.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:09.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:09.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:09.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:10.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:10.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:10.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:10.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:11.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:11.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:11.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:11.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:12.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:12.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:12.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:12.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:13.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:13.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:13.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:13.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:14.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:14.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:14.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:14.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:15.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:15.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:15.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:15.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:16.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:16.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:16.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:16.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:17.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:17.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:17.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:17.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:18.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:18.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:18.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:18.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:19.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:19.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:19.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:19.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:20.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:20.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:20.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:20.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:21.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:21.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:21.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:21.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:22.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:22.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:22.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:22.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:23.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:23.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:23.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:23.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:24.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:24.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:24.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:24.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:25.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:25.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:25.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:25.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:26.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:26.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:26.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:26.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:27.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:27.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:27.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:27.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:28.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:28.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:28.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:28.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:29.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:29.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:29.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:29.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:30.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:30.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:30.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:30.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:31.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:31.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:31.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:31.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:32.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:32.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:32.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:32.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:33.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:33.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:33.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:33.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:34.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:34.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:34.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:34.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:35.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:35.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:35.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:35.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:36.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:36.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:36.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:36.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:37.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:37.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:37.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:37.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:38.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:38.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:38.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:38.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:39.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:39.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:39.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:39.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:40.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:40.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:40.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:40.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:41.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:41.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:41.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:41.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:42.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:42.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:42.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:42.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:43.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:43.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:43.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:43.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:44.071 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T19:29:44.086+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac125ae0 msgr2=0x7f81ac0380a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T19:29:44.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:44.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:44.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:44.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:45.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:45.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:45.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:45.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:46.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:46.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:46.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:46.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:47.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:47.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:47.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:47.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:48.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:48.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:48.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:48.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:49.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:49.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:49.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:49.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:50.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:50.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:50.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:50.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:51.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:51.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:51.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:51.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:52.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:52.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:52.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:53.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:53.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:53.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:54.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:54.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:54.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:54.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:55.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:55.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:55.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:55.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:56.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:56.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:56.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:56.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:57.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:57.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:57.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:57.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:58.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:58.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:58.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:58.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:59.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:29:59.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:29:59.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:29:59.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:00.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:00.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:00.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:00.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:01.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:01.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:01.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:01.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:02.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:02.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:02.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:02.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:03.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:03.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:03.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:03.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:04.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:04.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:04.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:04.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:05.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:05.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:05.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:05.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:06.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:06.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:06.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:06.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:07.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:07.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:07.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:07.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:08.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:08.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:08.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:08.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:08.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:09.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:09.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:09.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:09.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:09.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:10.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:10.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:10.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:10.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:11.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:11.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:11.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:12.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:12.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:12.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:13.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:13.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:13.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:13.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:14.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:14.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:14.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:14.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:15.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:15.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:15.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:15.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:16.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:16.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:16.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:16.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:17.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:17.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:17.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:17.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:18.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:18.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:18.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:18.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:19.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:19.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:19.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:19.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:20.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:20.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:20.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:20.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:21.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:21.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:21.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:21.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:22.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:22.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:22.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:22.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:23.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:23.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:23.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:23.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:23.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:23.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:24.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:24.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:24.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:24.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:25.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:25.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:25.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:25.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:26.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:26.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:26.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:26.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:27.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:27.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:27.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:27.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:28.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:28.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:28.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:28.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:29.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:29.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:29.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:29.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:30.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:30.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:31.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:31.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:31.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:31.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:32.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:32.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:32.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:32.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:32.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:33.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:33.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:33.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:33.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:33.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:34.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:34.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:34.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:34.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:35.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:35.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:35.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:35.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:36.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:36.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:36.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:36.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:37.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:37.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:38.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:38.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:38.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:38.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:39.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:39.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:39.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:39.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:40.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:40.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:40.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:40.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:41.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:41.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:41.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:41.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:41.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:42.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:42.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:42.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:42.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:42.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:43.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:43.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:43.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:43.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:44.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:44.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:44.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:44.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:45.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:45.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:45.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:45.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:46.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:46.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:46.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:47.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:47.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:47.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:48.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:48.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:48.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:48.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:49.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:49.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:49.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:49.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:49.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:50.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:50.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:50.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:51.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:51.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:51.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:51.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:52.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:52.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:52.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:52.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:53.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:53.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:53.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:53.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:54.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:54.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:54.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:54.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:55.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:55.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:55.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:55.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:56.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:56.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:56.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:56.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:57.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:57.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:57.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:57.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:58.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:58.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:58.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:58.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:58.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:30:58.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:59.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:30:59.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:30:59.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:00.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:00.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:00.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:01.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:01.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:01.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:01.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:02.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:02.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:02.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:02.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:03.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:03.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:03.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:03.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:03.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:03.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:04.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:04.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:05.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:05.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:05.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:05.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:05.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:05.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:06.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:06.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:06.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:07.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:07.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:07.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:07.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:08.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:08.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:08.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:09.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:09.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:09.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:09.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:09.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:10.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:10.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:10.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:10.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:10.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:11.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:11.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:11.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:11.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:12.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:12.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:12.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:12.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:13.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:13.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:13.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:13.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:14.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:14.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:14.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:14.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:15.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:15.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:15.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:15.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:16.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:16.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:16.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:16.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:17.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:17.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:17.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:17.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:18.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:18.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:18.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:18.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:19.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:19.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:19.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:19.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:20.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:20.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:20.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:20.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:21.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:21.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:21.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:21.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:22.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:22.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:22.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:22.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:23.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:23.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:23.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:23.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:24.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:24.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:24.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:25.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:25.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:25.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:25.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:25.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:26.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:26.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:26.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:26.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:27.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:27.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:27.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:27.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:28.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:28.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:28.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:28.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:29.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:29.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:29.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:30.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:30.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:30.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:31.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:31.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:31.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:31.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:32.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:32.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:32.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:32.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:33.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:33.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:33.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:33.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:34.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:34.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:34.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:35.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:34.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:35.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:35.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:35.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:35.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:35.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:36.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:36.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:36.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:36.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:37.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:37.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:38.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:38.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:38.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:38.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:38.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:39.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:39.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:39.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:40.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:40.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:40.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:40.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:41.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:41.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:41.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:41.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:42.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:42.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:42.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:42.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:42.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:43.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:43.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:43.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:44.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:44.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:44.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:44.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:45.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:45.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:45.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:45.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:45.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:46.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:46.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:46.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:47.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:47.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:47.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:47.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:48.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:48.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:48.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:48.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:49.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:49.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:49.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:49.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:50.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:50.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:50.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:50.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:51.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:51.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:51.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:51.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:52.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:52.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:52.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:52.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:53.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:53.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:53.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:53.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:54.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:54.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:54.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:54.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:55.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:55.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:55.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:55.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:56.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:56.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:56.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:56.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:57.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:57.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:57.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:57.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:58.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:58.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:58.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:31:58.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:59.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:31:59.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:31:59.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:00.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:00.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:00.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:00.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:00.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:01.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:01.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:01.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:02.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:02.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:02.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:02.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:02.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:03.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:03.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:03.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:04.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:04.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:04.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:05.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:05.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:05.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:05.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:06.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:06.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:06.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:06.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:07.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:07.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:07.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:07.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:08.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:08.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:08.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:08.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:09.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:09.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:09.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:09.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:10.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:10.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:10.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:10.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:11.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:11.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:11.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:11.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:12.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:12.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:12.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:12.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:13.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:13.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:13.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:13.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:14.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:14.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:14.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:14.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:15.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:15.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:15.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:15.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:16.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:16.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:16.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:16.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:17.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:17.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:17.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:17.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:18.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:18.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:18.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:18.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:19.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:19.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:19.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:19.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:20.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:20.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:20.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:20.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:21.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:21.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:21.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:21.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:22.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:22.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:22.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:22.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:23.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:23.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:23.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:23.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:24.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:24.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:24.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:24.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:25.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:25.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:25.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:25.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:26.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:26.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:26.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:26.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:27.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:27.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:27.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:27.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:28.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:28.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:28.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:28.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:29.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:29.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:29.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:29.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:30.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:30.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:30.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:30.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:31.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:31.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:31.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:31.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:32.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:32.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:32.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:32.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:33.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:33.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:33.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:33.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:34.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:34.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:34.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:34.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:35.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:35.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:35.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:35.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:36.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:36.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:36.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:36.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:37.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:37.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:37.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:37.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:38.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:38.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:38.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:38.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:39.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:39.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:39.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:39.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:40.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:40.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:40.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:40.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:41.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:41.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:41.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:41.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:42.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:42.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:42.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:42.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:43.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:43.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:43.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:43.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:44.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:44.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:44.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:44.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:45.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:45.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:45.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:45.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:46.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:46.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:46.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:46.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:47.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:47.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:47.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:47.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:48.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:48.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:48.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:48.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:49.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:49.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:49.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:49.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:50.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:50.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:50.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:50.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:51.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:51.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:51.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:51.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:52.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:52.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:52.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:52.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:53.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:53.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:53.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:53.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:54.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:54.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:54.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:54.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:55.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:55.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:55.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:55.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:56.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:56.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:56.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:56.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:57.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:57.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:57.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:57.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:58.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:58.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:58.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:58.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:59.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:32:59.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:32:59.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:32:59.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:00.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:00.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:00.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:00.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:01.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:01.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:01.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:01.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:02.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:02.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:02.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:02.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:03.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:03.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:03.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:03.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:04.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:04.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:04.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:04.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:05.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:05.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:05.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:05.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:06.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:06.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:06.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:06.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:07.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:07.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:07.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:07.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:07.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:08.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:08.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:08.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:08.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:08.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:09.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:09.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:09.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:10.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:10.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:10.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:11.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:11.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:11.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:11.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:12.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:12.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:12.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:12.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:13.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:13.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:13.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:13.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:14.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:14.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:14.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:14.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:15.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:15.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:15.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:15.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:16.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:16.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:16.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:16.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:17.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:17.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:17.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:17.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:18.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:18.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:18.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:18.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:18.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:19.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:19.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:19.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:19.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:20.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:20.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:20.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:21.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:21.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:21.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:21.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:22.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:22.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:22.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:22.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:22.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:22.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:23.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:23.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:24.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:24.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:24.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:24.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:25.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:25.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:25.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:25.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:26.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:26.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:26.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:26.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:27.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:27.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:27.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:27.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:28.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:28.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:28.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:28.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:29.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:29.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:29.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:29.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:30.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:30.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:30.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:30.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:31.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:31.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:31.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:31.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:32.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:32.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:32.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:32.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:33.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:33.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:33.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:33.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:34.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:34.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:34.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:34.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:35.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:35.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:35.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:35.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:36.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:36.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:36.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:36.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:37.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:37.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:37.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:37.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:38.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:38.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:38.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:38.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:38.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:39.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:39.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:39.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:40.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:40.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:40.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:40.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:40.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:40.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:41.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:41.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:41.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:41.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:42.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:42.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:42.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:42.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:43.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:43.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:43.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:44.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:44.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:44.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:45.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:45.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:45.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:45.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:46.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:46.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:46.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:46.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:47.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:47.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:47.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:47.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:48.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:48.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:48.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:48.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:49.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:49.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:49.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:49.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:50.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:50.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:50.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:50.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:51.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:51.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:51.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:51.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:52.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:52.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:52.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:52.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:53.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:53.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:53.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:53.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:54.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:54.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:54.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:54.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:55.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:55.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:55.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:55.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:56.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:56.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:56.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:56.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:57.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:57.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:57.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:57.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:58.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:58.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:58.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:58.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:59.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:33:59.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:33:59.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:33:59.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:00.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:00.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:00.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:00.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:01.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:01.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:01.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:01.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:02.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:02.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:02.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:02.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:03.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:03.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:03.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:03.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:04.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:04.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:04.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:04.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:05.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:05.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:05.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:05.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:06.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:06.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:06.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:06.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:07.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:07.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:07.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:07.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:08.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:08.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:08.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:08.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:09.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:09.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:09.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:09.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:10.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:10.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:10.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:10.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:11.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:11.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:11.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:11.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:12.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:12.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:12.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:12.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:13.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:13.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:13.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:13.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:14.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:14.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:14.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:14.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:15.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:15.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:15.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:15.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:16.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:16.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:16.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:16.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:17.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:17.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:17.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:17.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:18.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:18.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:18.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:18.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:19.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:19.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:19.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:19.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:20.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:20.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:20.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:20.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:21.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:21.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:21.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:21.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:22.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:22.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:22.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:22.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:23.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:23.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:23.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:23.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:24.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:24.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:24.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:24.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:25.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:25.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:25.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:25.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:26.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:26.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:26.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:26.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:27.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:27.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:27.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:27.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:28.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:28.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:28.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:28.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:29.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:29.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:29.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:29.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:30.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:30.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:30.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:30.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:31.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:31.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:31.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:31.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:32.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:32.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:32.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:32.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:33.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:33.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:33.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:33.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:34.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:34.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:34.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:34.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:35.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:35.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:35.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:35.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:36.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:36.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:36.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:36.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:37.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:37.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:37.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:37.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:38.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:38.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:38.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:38.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:39.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:39.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:39.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:39.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:40.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:40.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:40.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:40.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:41.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:41.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:41.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:41.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:42.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:42.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:42.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:42.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:43.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:43.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:43.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:43.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:44.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:44.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:44.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:44.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:45.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:45.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:45.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:45.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:46.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:46.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:46.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:46.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:47.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:47.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:47.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:47.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:48.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:48.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:48.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:48.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:49.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:49.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:49.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:49.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:50.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:50.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:50.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:50.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:51.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:51.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:51.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:51.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:52.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:52.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:52.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:52.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:53.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:53.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:53.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:53.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:54.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:54.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:54.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:54.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:55.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:55.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:55.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:55.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:56.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:56.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:56.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:56.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:56.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:57.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:57.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:57.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:57.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:57.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:58.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:58.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:58.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:58.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:59.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:34:59.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:34:59.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:34:59.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:00.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:00.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:00.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:01.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:01.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:01.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:01.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:02.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:02.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:02.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:03.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:03.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:03.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:03.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:04.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:04.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:04.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:04.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:05.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:05.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:05.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:05.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:06.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:06.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:06.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:06.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:07.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:07.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:07.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:07.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:08.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:08.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:08.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:08.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:09.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:09.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:09.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:09.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:10.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:10.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:10.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:10.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:10.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:11.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:11.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:11.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:11.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:11.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:12.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:12.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:13.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:13.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:13.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:13.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:14.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:14.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:14.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:14.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:15.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:15.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:15.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:15.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:16.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:16.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:16.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:16.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:17.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:17.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:17.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:17.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:18.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:18.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:18.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:18.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:19.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:19.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:19.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:19.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:20.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:20.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:20.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:20.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:21.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:21.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:21.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:21.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:22.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:22.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:22.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:22.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:23.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:23.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:23.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:23.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:24.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:24.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:24.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:24.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:25.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:25.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:25.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:25.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:26.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:26.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:26.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:26.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:26.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:26.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:27.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:27.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:27.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:27.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:28.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:28.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:28.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:28.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:29.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:29.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:29.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:29.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:30.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:30.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:30.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:30.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:31.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:31.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:31.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:31.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:32.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:32.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:32.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:32.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:33.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:33.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:34.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:34.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:34.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:34.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:35.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:35.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:35.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:35.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:35.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:36.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:36.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:36.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:36.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:37.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:37.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:37.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:38.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:38.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:38.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:38.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:38.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:38.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:39.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:39.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:40.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:40.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:40.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:40.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:41.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:41.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:41.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:41.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:42.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:42.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:42.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:42.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:42.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:43.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:43.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:43.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:43.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:43.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:44.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:44.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:44.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:44.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:45.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:45.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:45.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:45.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:46.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:46.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:46.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:46.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:47.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:47.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:47.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:47.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:48.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:48.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:48.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:48.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:49.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:49.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:49.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:49.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:50.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:50.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:50.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:50.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:51.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:51.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:51.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:51.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:52.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:52.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:52.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:52.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:53.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:53.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:53.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:53.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:54.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:54.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:54.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:55.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:55.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:55.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:55.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:56.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:56.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:56.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:57.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:57.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:57.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:57.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:57.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:58.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:58.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:58.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:58.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:59.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:59.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:35:59.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:35:59.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:35:59.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:00.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:00.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:00.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:00.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:01.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:01.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:01.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:01.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:02.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:02.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:02.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:02.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:03.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:03.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:03.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:03.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:04.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:04.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:04.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:04.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:05.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:05.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:05.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:05.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:06.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:06.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:06.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:06.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:07.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:07.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:07.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:07.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:08.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:08.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:08.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:08.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:09.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:09.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:09.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:10.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:10.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:10.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:10.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:10.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:11.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:11.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:11.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:11.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:12.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:12.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:12.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:13.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:13.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:13.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:14.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:14.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:14.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:14.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:14.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:14.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:15.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:15.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:15.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:15.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:16.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:16.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:16.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:17.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:17.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:17.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:17.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:18.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:18.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:18.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:18.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:18.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:19.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:19.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:19.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:20.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:20.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:20.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:21.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:21.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:21.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:21.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:22.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:22.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:22.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:22.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:23.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:23.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:23.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:23.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:24.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:24.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:24.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:24.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:25.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:25.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:25.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:25.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:26.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:26.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:26.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:26.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:27.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:27.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:27.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:27.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:28.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:28.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:28.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:28.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:29.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:29.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:29.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:29.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:30.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:30.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:30.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:30.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:31.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:31.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:31.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:31.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:32.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:32.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:32.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:32.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:33.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:33.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:33.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:33.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:34.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:34.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:34.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:34.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:35.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:35.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:35.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:35.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:36.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:36.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:36.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:36.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:37.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:37.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:37.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:37.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:38.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:38.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:38.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:38.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:39.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:39.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:39.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:39.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:40.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:40.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:40.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:40.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:41.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:41.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:41.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:41.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:42.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:42.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:42.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:42.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:43.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:43.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:43.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:43.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:44.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:44.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:44.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:44.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 54 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:45.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:45.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:45.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:45.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:46.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:46.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:46.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:46.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:47.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:47.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:47.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:47.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:48.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:48.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:48.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:48.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:49.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:49.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:49.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:49.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:50.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:50.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:50.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:50.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:51.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:51.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:51.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:51.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:52.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:52.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:52.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:52.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:53.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:53.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:53.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:53.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:54.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:54.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:54.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:54.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:55.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:55.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:55.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:55.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:56.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:56.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:56.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:56.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:57.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:57.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:57.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:57.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:58.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:58.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:58.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:58.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:36:59.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:36:59.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:36:59.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:36:59.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:00.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:00.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:00.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:00.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:01.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:01.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:01.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:01.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:02.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:02.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:02.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:02.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:03.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:03.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:03.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:03.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:04.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:04.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:04.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:04.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:05.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:05.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:05.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:05.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:06.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:06.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:06.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:06.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:07.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:07.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:07.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:07.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:08.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:08.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:08.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:08.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:09.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:09.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:09.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:09.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:10.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:10.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:10.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:10.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:11.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:11.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:11.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:11.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:12.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:12.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:12.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:12.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:13.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:13.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:13.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:13.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:14.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:14.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:14.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:14.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 22 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:37:15.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:15.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:15.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:15.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:16.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:16.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:16.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:16.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:17.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:17.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:17.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:17.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:18.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:18.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:18.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:18.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:19.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:19.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:19.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:19.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:20.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:20.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:20.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:20.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:21.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:21.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:21.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:21.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:22.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:22.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:22.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:22.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:23.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:23.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:23.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:23.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:24.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:24.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:24.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:24.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:25.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:25.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:25.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:25.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:26.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:26.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:26.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:26.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:27.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:27.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:27.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:27.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:28.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:28.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:28.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:28.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:29.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:29.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:29.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:29.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:30.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:30.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:30.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:30.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:31.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:31.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:31.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:31.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:32.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:32.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:32.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:32.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:33.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:33.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:33.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:33.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:34.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:34.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:34.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:34.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:35.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:35.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:35.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:35.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:36.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:36.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:36.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:36.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:37.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:37.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:37.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:37.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:38.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:38.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:38.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:38.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:39.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:39.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:39.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:39.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:40.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:40.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:40.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:40.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:41.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:41.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:41.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:41.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:42.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:42.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:42.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:42.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:43.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:43.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:43.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:43.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:44.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:44.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:44.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:44.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:45.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:45.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:45.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:45.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:46.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:46.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:46.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:46.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:47.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:47.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:47.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:47.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:48.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:48.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:48.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:48.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:49.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:49.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:49.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:49.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:50.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:50.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:50.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:50.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:51.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:51.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:51.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:51.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:52.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:52.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:52.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:52.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:53.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:53.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:53.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:53.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:54.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:54.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:54.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:54.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:55.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:55.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:55.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:55.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:56.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:56.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:56.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:56.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:57.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:57.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:57.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:57.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:58.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:58.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:58.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:58.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:59.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:37:59.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:37:59.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:37:59.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:00.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:00.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:00.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:00.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:01.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:01.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:01.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:01.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:02.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:02.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:02.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:02.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:03.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:03.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:03.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:03.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:04.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:04.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:04.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:04.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:05.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:05.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:05.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:05.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:06.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:06.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:06.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:06.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:07.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:07.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:07.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:07.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:08.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:08.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:08.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:08.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:09.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:09.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:09.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:09.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:10.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:10.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:10.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:10.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:11.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:11.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:11.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:11.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:12.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:12.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:12.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:12.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:13.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:13.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:13.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:13.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:14.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:14.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:14.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:14.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:15.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:15.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:15.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:15.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:16.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:16.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:16.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:16.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:17.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:17.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:17.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:17.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:18.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:18.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:18.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:18.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:19.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:19.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:19.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:19.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:20.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:20.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:20.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:20.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:21.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:21.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:21.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:21.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:22.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:22.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:22.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:22.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:23.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:23.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:23.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:23.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:24.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:24.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:24.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:24.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:25.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:25.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:25.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:25.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:26.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:26.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:26.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:26.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:27.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:27.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:27.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:27.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:28.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:28.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:28.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:28.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:29.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:29.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:29.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:29.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:30.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:30.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:30.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:30.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:31.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:31.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:31.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:31.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:32.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:32.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:32.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:32.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:33.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:33.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:33.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:33.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:34.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:34.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:34.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:34.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:35.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:35.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:35.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:35.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:36.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:36.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:36.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:36.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:37.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:37.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:37.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:37.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:38.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:38.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:38.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:38.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:39.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:39.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:39.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:39.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:40.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:40.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:40.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:40.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:41.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:41.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:41.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:41.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:42.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:42.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:42.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:42.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:43.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:43.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:43.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:43.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:44.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:44.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:44.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:44.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:45.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:45.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:45.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:45.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:46.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:46.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:46.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:46.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:47.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:47.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:47.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:47.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:48.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:48.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:48.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:48.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:49.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:49.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:49.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:49.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:50.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:50.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:50.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:50.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:51.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:51.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:51.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:51.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:52.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:52.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:52.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:52.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:53.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:53.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:53.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:53.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:54.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:54.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:54.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:54.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:55.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:55.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:55.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:55.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:56.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:56.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:56.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:56.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:57.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:57.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:57.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:57.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:58.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:58.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:58.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:58.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:59.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:38:59.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:38:59.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:38:59.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:00.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:00.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:00.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:00.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:01.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:01.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:01.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:01.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:02.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:02.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:02.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:03.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:03.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:03.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:03.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:03.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:04.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:04.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:05.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:05.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:05.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:05.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:06.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:06.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:06.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:06.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:06.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:07.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:07.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:07.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:07.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:07.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:08.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:08.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:08.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:08.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:09.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:09.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:09.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:09.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:10.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:10.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:10.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:10.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:11.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:11.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:11.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:11.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:12.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:12.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:13.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:13.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:13.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:13.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:14.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:14.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:14.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:14.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:15.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:15.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:15.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:15.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:16.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:16.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:16.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:16.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:17.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:17.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:17.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:17.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:18.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:18.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:18.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:18.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:19.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:19.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:19.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:19.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:20.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:20.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:20.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:20.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:21.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:21.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:21.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:21.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:22.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:22.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:22.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:22.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:23.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:23.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:23.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:23.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:24.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:24.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:24.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:24.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:25.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:25.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:25.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:25.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:26.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:26.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:26.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:26.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:27.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:27.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:27.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:27.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:27.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:27.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:28.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:28.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:28.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:28.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:29.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:29.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:29.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:29.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:30.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:30.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:30.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:30.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:31.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:31.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:31.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:32.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:32.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:32.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:32.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:32.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:33.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:33.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:33.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:33.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:34.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:34.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:34.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:34.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:35.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:35.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:35.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:35.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:36.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:36.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:36.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:36.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:37.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:37.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:37.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:37.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:38.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:38.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:38.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:38.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:39.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:39.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:39.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:39.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:40.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:40.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:40.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:40.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:41.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:41.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:41.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:41.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:42.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:42.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:42.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:42.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:43.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:43.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:43.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:43.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:44.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:44.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:44.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:44.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:45.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:45.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:45.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:45.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:46.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:46.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:46.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:46.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:47.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:47.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:47.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:47.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:48.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:48.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:48.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:48.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:49.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:49.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:49.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:49.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:50.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:50.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:50.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:50.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:51.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:51.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:51.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:51.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:52.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:52.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:52.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:52.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:53.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:53.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:53.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:53.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:54.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:54.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:54.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:54.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:55.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:55.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:55.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:55.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:56.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:56.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:56.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:56.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:57.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:57.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:57.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:57.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:58.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:58.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:58.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:58.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:59.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:39:59.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:39:59.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:39:59.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:00.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:00.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:00.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:00.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:01.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:01.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:01.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:01.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:02.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:02.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:02.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:02.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:03.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:03.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:03.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:03.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:04.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:04.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:04.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:04.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:05.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:05.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:05.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:05.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:06.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:06.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:06.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:06.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:07.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:07.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:07.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:07.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:08.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:08.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:08.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:08.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:09.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:09.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:09.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:09.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:10.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:10.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:10.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:10.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:11.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:11.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:11.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:11.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:12.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:12.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:12.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:12.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:13.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:13.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:13.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:13.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:14.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:14.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:14.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:14.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:15.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:15.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:15.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:15.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:16.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:16.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:16.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:16.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:17.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:17.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:17.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:17.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:18.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:18.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:18.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:18.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:19.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:19.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:19.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:19.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:20.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:20.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:20.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:20.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:21.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:21.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:21.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:21.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:22.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:22.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:22.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:22.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:23.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:23.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:23.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:23.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:24.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:24.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:24.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:25.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:25.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:25.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:26.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:26.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:26.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:26.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:27.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:27.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:27.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:27.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:28.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:28.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:28.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:28.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:29.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:29.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:29.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:29.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:29.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:29.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:30.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:30.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:31.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:31.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:31.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:31.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:32.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:32.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:32.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:32.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:33.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:33.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:33.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:33.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:34.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:34.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:34.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:34.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:35.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:35.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:35.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:35.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:36.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:36.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:36.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:36.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:37.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:37.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:37.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:37.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:38.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:38.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:38.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:38.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:39.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:39.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:39.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:39.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:40.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:40.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:40.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:40.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:41.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:41.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:41.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:41.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:42.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:42.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:42.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:42.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:43.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:43.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:43.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:43.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:44.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:44.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:44.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:44.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:45.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:45.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:45.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:45.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:46.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:46.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:46.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:46.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:47.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:47.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:47.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:47.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:48.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:48.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:48.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:48.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:49.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:49.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:49.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:49.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:50.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:50.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:50.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:50.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:51.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:51.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:51.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:51.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:52.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:52.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:52.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:52.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:52.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:53.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:53.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:53.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:53.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:54.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:54.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:54.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:54.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:54.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:55.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:55.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:55.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:55.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:56.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:56.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:56.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:56.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:57.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:57.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:57.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:57.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:58.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:58.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:58.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:58.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:59.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:40:59.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:40:59.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:40:59.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:00.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:00.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:00.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:00.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:01.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:01.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:01.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:01.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:02.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:02.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:02.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:02.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:03.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:03.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:03.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:03.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:04.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:04.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:04.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:04.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:05.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:05.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:05.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:05.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:06.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:06.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:06.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:06.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:07.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:07.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:07.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:07.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:08.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:08.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:08.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:08.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:09.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:09.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:09.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:09.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:10.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:10.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:10.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:10.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:11.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:11.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:11.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:11.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:12.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:12.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:12.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:12.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:13.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:13.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:13.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:13.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:14.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:14.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:14.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:14.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:15.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:15.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:15.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:15.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:16.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:16.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:16.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:16.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:17.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:17.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:17.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:17.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:18.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:18.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:18.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:18.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:19.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:19.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:19.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:19.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:20.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:20.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:20.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:20.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:21.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:21.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:21.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:21.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:22.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:22.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:22.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:22.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:23.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:23.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:23.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:23.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:24.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:24.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:24.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:24.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:25.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:25.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:25.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:25.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:26.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:26.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:26.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:26.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:27.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:27.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:27.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:27.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:27.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:28.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:28.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:28.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:29.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:29.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:29.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:29.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:30.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:30.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:30.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:30.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:31.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:31.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:31.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:31.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:32.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:32.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:32.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:32.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:33.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:33.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:33.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:33.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:34.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:34.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:34.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:34.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:35.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:35.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:35.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:35.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:36.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:36.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:36.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:36.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:37.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:37.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:37.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:37.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:38.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:38.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:38.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:38.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:39.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:39.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:39.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:39.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:40.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:40.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:40.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:40.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:41.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:41.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:41.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:41.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:41.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:41.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:42.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:42.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:43.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:43.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:43.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:43.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:44.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:44.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:44.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:44.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:44.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:44.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:45.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:45.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:45.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:45.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:46.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:46.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:46.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:46.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:47.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:47.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:48.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:48.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:48.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:48.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:48.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:49.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:49.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:49.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:50.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:50.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:50.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:50.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:51.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:51.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:51.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:51.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:52.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:52.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:52.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:52.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:53.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:53.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:53.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:53.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:54.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:54.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:54.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:54.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:55.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:55.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:55.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:55.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:56.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:56.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:56.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:56.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:57.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:57.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:57.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:57.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:58.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:58.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:58.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:58.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:59.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:41:59.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:41:59.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:41:59.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:00.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:00.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:00.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:00.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:01.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:01.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:01.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:01.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:02.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:02.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:02.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:02.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:03.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:03.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:03.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:03.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:04.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:04.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:04.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:04.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:05.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:05.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:05.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:05.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:06.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:06.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:06.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:06.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:07.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:07.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:07.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:07.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:08.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:08.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:08.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:08.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:09.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:09.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:09.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:09.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:10.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:10.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:10.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:10.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:11.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:11.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:11.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:11.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:12.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:12.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:12.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:12.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:13.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:13.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:13.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:13.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:14.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:14.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:14.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:14.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:15.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:15.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:15.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:15.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:16.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:16.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:16.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:16.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:17.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:17.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:17.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:17.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:18.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:18.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:18.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:18.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:19.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:19.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:19.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:19.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:20.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:20.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:20.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:20.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:21.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:21.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:21.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:21.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:22.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:22.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:22.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:22.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:23.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:23.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:23.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:23.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:24.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:24.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:24.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:24.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:25.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:25.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:25.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:25.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:26.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:26.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:26.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:26.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:27.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:27.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:27.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:27.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:28.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:28.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:28.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:28.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:29.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:29.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:29.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:29.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:30.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:30.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:30.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:30.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:31.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:31.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:31.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:31.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:32.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:32.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:32.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:32.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:33.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:33.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:33.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:33.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:34.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:34.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:34.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:34.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:35.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:35.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:35.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:35.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:36.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:36.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:36.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:36.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:37.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:37.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:37.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:37.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:38.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:38.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:38.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:38.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:39.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:39.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:39.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:39.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:40.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:40.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:40.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:40.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:41.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:41.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:41.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:41.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:42.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:42.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:42.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:42.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:43.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:43.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:43.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:43.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:44.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:44.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:44.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:44.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:45.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:45.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:45.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:45.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:46.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:46.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:46.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:46.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:47.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:47.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:47.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:47.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:48.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:48.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:48.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:48.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:49.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:49.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:49.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:49.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:50.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:50.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:50.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:50.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:51.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:51.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:51.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:51.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:52.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:52.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:52.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:52.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:53.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:53.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:53.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:53.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:54.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:54.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:54.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:54.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:55.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:55.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:55.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:55.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:56.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:56.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:56.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:56.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:57.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:57.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:57.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:57.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:58.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:58.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:58.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:58.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:59.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:42:59.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:42:59.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:42:59.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:00.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:00.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:00.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:00.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:01.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:01.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:01.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:01.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:02.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:02.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:02.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:02.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:03.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:03.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:03.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:03.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:04.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:04.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:04.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:04.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:05.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:05.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:05.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:05.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:06.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:06.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:06.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:06.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:07.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:07.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:07.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:07.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:08.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:08.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:08.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:08.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:09.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:09.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:09.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:09.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:10.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:10.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:10.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:10.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:11.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:11.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:11.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:11.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:12.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:12.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:12.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:12.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:13.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:13.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:13.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:13.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:14.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:14.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:14.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:14.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:15.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:15.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:15.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:15.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:16.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:16.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:16.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:16.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:17.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:17.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:17.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:17.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:18.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:18.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:18.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:18.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:19.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:19.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:19.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:19.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:20.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:20.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:20.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:20.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:21.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:21.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:21.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:21.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:22.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:22.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:22.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:22.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:23.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:23.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:23.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:23.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:24.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:24.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:24.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:24.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:25.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:25.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:25.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:25.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:26.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:26.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:26.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:26.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:27.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:27.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:27.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:27.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:28.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:28.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:28.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:28.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:29.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:29.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:29.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:29.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:30.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:30.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:30.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:30.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:31.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:31.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:31.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:31.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:32.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:32.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:32.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:32.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:33.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:33.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:33.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:33.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:34.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:34.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:34.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:34.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:35.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:35.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:35.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:35.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:36.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:36.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:36.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:36.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:37.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:37.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:37.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:37.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:38.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:38.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:38.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:38.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:39.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:39.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:39.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:39.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:40.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:40.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:40.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:40.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:41.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:41.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:41.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:41.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:42.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:42.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:42.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:42.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:43.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:43.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:43.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:43.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:44.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:44.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:44.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:44.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:45.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:45.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:45.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:45.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:46.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:46.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:46.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:46.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:47.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:47.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:47.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:47.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:48.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:48.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:48.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:48.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:49.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:49.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:49.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:49.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:50.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:50.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:50.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:50.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:51.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:51.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:51.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:51.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:52.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:52.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:52.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:52.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:53.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:53.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:53.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:53.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:54.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:54.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:54.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:54.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:55.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:55.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:55.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:55.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:56.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:56.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:56.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:56.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:57.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:57.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:57.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:57.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:58.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:58.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:58.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:58.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:59.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:43:59.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:43:59.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:43:59.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:00.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:00.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:00.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:00.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:01.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:01.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:01.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:01.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:02.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:02.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:02.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:02.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:03.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:03.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:03.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:03.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:04.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:04.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:04.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:04.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:05.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:05.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:05.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:05.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:06.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:06.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:06.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:06.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:07.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:07.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:07.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:07.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:08.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:08.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:08.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:08.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:09.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:09.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:09.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:09.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:10.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:10.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:10.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:10.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:11.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:11.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:11.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:11.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:12.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:12.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:12.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:12.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:13.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:13.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:13.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:13.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:14.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:14.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:14.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:14.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:15.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:15.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:15.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:15.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:16.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:16.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:16.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:16.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:17.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:17.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:17.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:17.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:18.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:18.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:18.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:18.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:19.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:19.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:19.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:19.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:20.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:20.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:20.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:20.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:21.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:21.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:21.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:21.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:22.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:22.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:22.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:22.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:23.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:23.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:23.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:23.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:24.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:24.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:24.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:24.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:25.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:25.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:25.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:25.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:26.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:26.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:26.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:26.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:27.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:27.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:27.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:27.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:28.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:28.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:28.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:28.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:29.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:29.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:29.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:29.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:30.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:30.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:30.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:30.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:31.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:31.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:31.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:31.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:32.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:32.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:32.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:32.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:33.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:33.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:33.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:33.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:34.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:34.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:34.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:34.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:35.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:35.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:35.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:35.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:36.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:36.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:36.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:36.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:37.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:37.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:37.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:37.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:38.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:38.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:38.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:38.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:39.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:39.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:39.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:39.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:40.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:40.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:40.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:40.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:41.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:41.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:41.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:41.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:42.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:42.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:42.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:42.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:43.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:43.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:43.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:43.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:44.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:44.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:44.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:44.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:45.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:45.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:45.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:45.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:46.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:46.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:46.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:46.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:47.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:47.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:47.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:47.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:48.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:48.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:48.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:48.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:49.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:49.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:49.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:49.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:50.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:50.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:50.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:50.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:51.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:51.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:51.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:51.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:52.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:52.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:52.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:52.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:53.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:53.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:53.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:53.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:54.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:54.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:54.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:54.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:55.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:55.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:55.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:55.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:56.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:56.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:56.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:56.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:57.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:57.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:57.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:57.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:58.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:58.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:58.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:58.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:59.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:44:59.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:44:59.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:44:59.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:00.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:00.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:00.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:00.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:01.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:01.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:01.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:01.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:02.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:02.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:02.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:02.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:03.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:03.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:03.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:03.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:04.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:04.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:04.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:04.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:05.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:05.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:05.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:05.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:06.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:06.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:06.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:06.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:07.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:07.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:07.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:07.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:08.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:08.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:08.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:08.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:09.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:09.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:09.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:09.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:10.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:10.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:10.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:10.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:11.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:11.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:11.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:11.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:12.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:12.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:12.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:12.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:13.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:13.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:13.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:13.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:14.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:14.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:14.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:14.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:15.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:15.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:15.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:15.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:16.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:16.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:16.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:16.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:17.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:17.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:17.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:17.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:18.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:18.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:18.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:18.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:19.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:19.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:19.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:19.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:20.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:20.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:20.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:20.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:21.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:21.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:21.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:21.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:22.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:22.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:22.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:22.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:23.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:23.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:23.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:23.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:24.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:24.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:24.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:24.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:25.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:25.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:25.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:25.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:26.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:26.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:26.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:26.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:27.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:27.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:27.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:27.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:28.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:28.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:28.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:28.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:29.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:29.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:30.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:30.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:30.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:30.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:30.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:30.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:31.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:31.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:32.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:32.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:32.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:32.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:33.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:33.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:33.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:33.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:33.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:33.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:34.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:34.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:34.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:34.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:35.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:35.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:35.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:35.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:36.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:36.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:36.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:36.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:37.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:37.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:37.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:37.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:38.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:38.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:38.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:38.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:39.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:39.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:39.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:39.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:40.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:40.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:40.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:40.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:41.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:41.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:41.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:41.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:42.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:42.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:42.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:42.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:43.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:43.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:43.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:43.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:44.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:44.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:44.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:44.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:45.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:45.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:45.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:45.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:46.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:46.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:46.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:46.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:47.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:47.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:47.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:47.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:48.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:48.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:48.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:48.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:49.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:49.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:49.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:49.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:50.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:50.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:50.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:50.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:51.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:51.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:51.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:51.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:52.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:52.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:52.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:52.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:53.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:53.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:53.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:53.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:54.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:54.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:54.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:54.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:55.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:55.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:55.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:55.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:56.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:56.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:56.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:56.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:57.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:57.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:57.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:57.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:58.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:58.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:58.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:58.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:59.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:45:59.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:45:59.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:45:59.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:00.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:00.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:00.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:00.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:01.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:01.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:01.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:01.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:02.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:02.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:02.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:02.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:03.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:03.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:03.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:03.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:04.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:04.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:04.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:04.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:05.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:05.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:05.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:05.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:06.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:06.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:06.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:06.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:07.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:07.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:07.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:07.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:08.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:08.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:08.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:08.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:09.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:09.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:09.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:09.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:10.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:10.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:10.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:10.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:11.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:11.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:11.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:11.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:12.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:12.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:12.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:12.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:13.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:13.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:13.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:13.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:14.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:14.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:14.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:14.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:15.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:15.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:15.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:15.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:16.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:16.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:16.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:16.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:17.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:17.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:17.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:17.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:18.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:18.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:18.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:18.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:19.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:19.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:19.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:19.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:20.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:20.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:20.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:20.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:21.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:21.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:21.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:21.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:22.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:22.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:22.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:22.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:23.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:23.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:23.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:23.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:24.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:24.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:24.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:24.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:25.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:25.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:25.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:25.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:26.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:26.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:26.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:26.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:27.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:27.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:27.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:27.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:28.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:28.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:28.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:28.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:29.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:29.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:29.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:29.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:30.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:30.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:30.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:30.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:31.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:31.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:31.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:31.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:32.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:32.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:32.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:32.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:33.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:33.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:33.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:33.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:34.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:34.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:34.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:34.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:35.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:35.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:35.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:35.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:36.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:36.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:36.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:36.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:37.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:37.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:37.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:37.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:38.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:38.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:38.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:38.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:39.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:39.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:39.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:39.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:40.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:40.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:40.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:40.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:41.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:41.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:41.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:41.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:42.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:42.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:42.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:42.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:43.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:43.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:43.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:43.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:44.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:44.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:44.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:44.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:45.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:45.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:45.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:45.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:46.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:46.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:46.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:46.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:47.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:47.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:47.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:47.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:48.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:48.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:48.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:48.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:49.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:49.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:49.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:49.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:50.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:50.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:50.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:50.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:51.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:51.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:51.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:51.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:52.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:52.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:52.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:52.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:53.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:53.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:53.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:53.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:54.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:54.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:54.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:54.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:55.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:55.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:55.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:55.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:56.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:56.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:56.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:56.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:57.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:57.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:57.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:57.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:58.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:58.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:58.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:58.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:59.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:46:59.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:46:59.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:46:59.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:00.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:00.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:00.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:00.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:01.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:01.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:01.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:01.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:02.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:02.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:02.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:02.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:03.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:03.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:03.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:03.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:04.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:04.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:04.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:04.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:05.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:05.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:05.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:05.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:06.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:06.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:06.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:06.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:07.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:07.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:07.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:07.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:08.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:08.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:08.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:08.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:09.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:09.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:09.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:09.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:10.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:10.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:10.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:10.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:11.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:11.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:11.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:11.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:12.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:12.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:12.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:12.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:13.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:13.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:13.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:13.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:14.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:14.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:14.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:14.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:15.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:15.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:15.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:15.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:16.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:16.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:16.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:16.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:17.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:17.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:17.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:17.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:18.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:18.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:18.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:18.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:19.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:19.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:19.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:19.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:20.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:20.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:20.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:20.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:21.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:21.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:21.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:21.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:22.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:22.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:22.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:22.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:23.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:23.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:23.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:23.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:24.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:24.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:24.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:24.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:25.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:25.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:25.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:25.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:26.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:26.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:26.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:26.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:27.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:27.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:27.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:27.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:28.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:28.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:28.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:28.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:29.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:29.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:29.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:29.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:30.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:30.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:30.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:30.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:31.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:31.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:31.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:31.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:32.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:32.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:32.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:32.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:33.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:33.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:33.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:33.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:34.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:34.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:34.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:34.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:35.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:35.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:35.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:35.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:36.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:36.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:36.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:36.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:37.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:37.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:37.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:37.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:38.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:38.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:38.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:38.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:39.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:39.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:39.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:39.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:40.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:40.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:40.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:40.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:41.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:41.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:41.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:41.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:42.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:42.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:42.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:42.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:43.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:43.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:43.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:43.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:44.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:44.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:44.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:44.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:45.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:45.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:45.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:45.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:46.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:46.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:46.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:46.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:47.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:47.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:47.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:47.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:48.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:48.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:48.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:48.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:49.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:49.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:49.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:49.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:50.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:50.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:50.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:50.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:51.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:51.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:51.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:51.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:52.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:52.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:52.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:52.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:53.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:53.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:53.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:53.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:54.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:54.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:54.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:54.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:55.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:55.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:55.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:55.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:56.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:56.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:56.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:56.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:57.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:57.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:57.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:57.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:58.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:58.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:58.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:58.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:59.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:47:59.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:47:59.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:47:59.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:00.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:00.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:00.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:00.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:01.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:01.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:01.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:01.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:02.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:02.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:02.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:02.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:03.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:03.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:03.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:03.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:04.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:04.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:04.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:04.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:05.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:05.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:05.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:05.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:06.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:06.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:06.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:06.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:07.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:07.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:07.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:07.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:08.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:08.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:08.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:08.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:09.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:09.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:09.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:09.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:10.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:10.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:10.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:10.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:11.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:11.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:11.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:11.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:12.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:12.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:12.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:12.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:13.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:13.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:13.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:13.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:14.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:14.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:14.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:14.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:15.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:15.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:15.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:15.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:16.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:16.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:16.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:16.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:17.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:17.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:17.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:17.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:18.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:18.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:18.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:18.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:19.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:19.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:19.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:19.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:20.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:20.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:20.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:20.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:21.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:21.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:21.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:21.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:22.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:22.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:22.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:22.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:23.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:23.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:23.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:23.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:24.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:24.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:24.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:24.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:25.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:25.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:25.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:25.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:26.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:26.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:26.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:26.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:27.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:27.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:27.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:27.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:28.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:28.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:28.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:28.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:29.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:29.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:29.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:29.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:30.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:30.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:30.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:30.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:31.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:31.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:31.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:31.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:32.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:32.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:32.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:32.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:33.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:33.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:33.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:33.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:34.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:34.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:34.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:34.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:35.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:35.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:35.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:35.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:36.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:36.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:36.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:36.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:37.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:37.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:37.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:37.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:38.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:38.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:38.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:38.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:39.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:39.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:39.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:39.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:40.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:40.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:40.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:40.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:41.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:41.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:41.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:41.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:42.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:42.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:42.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:42.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:43.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:43.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:43.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:43.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:44.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:44.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:44.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:44.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:45.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:45.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:45.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:45.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:46.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:46.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:46.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:46.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:47.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:47.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:47.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:47.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:48.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:48.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:48.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:48.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:49.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:49.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:49.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:49.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:50.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:50.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:50.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:50.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:51.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:51.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:51.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:51.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:52.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:52.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:52.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:52.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:53.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:53.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:53.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:53.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:54.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:54.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:54.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:54.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:55.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:55.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:55.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:55.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:56.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:56.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:56.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:56.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:57.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:57.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:57.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:57.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:58.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:58.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:58.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:58.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:59.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:48:59.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:48:59.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:48:59.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:00.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:00.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:00.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:00.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:01.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:01.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:01.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:01.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:02.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:02.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:02.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:02.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:03.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:03.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:03.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:03.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:04.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:04.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:04.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:04.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:05.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:05.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:05.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:05.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:06.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:06.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:06.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:06.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:07.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:07.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:07.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:07.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:08.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:08.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:08.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:08.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:09.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:09.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:09.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:09.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:10.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:10.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:10.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:10.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:11.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:11.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:11.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:11.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:12.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:12.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:12.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:12.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:13.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:13.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:13.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:13.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:14.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:14.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:14.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:14.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:15.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:15.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:15.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:15.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:16.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:16.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:16.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:16.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:17.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:17.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:17.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:17.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:18.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:18.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:18.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:18.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:19.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:19.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:19.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:19.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:20.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:20.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:20.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:20.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:21.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:21.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:21.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:21.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:22.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:22.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:22.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:22.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:23.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:23.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:23.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:23.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:24.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:24.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:24.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:24.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:25.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:25.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:25.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:25.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:26.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:26.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:26.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:26.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:27.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:27.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:27.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:27.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:28.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:28.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:28.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:28.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:29.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:29.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:29.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:29.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:30.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:30.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:30.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:30.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:31.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:31.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:31.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:31.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:32.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:32.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:32.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:32.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:33.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:33.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:33.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:33.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:34.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:34.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:34.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:34.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:35.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:35.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:35.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:35.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:36.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:36.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:36.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:36.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:37.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:37.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:37.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:37.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:38.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:38.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:38.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:38.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:39.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:39.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:39.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:39.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:40.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:40.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:40.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:40.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:41.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:41.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:41.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:41.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:42.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:42.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:42.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:42.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:43.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:43.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:43.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:43.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:44.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:44.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:44.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:44.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:45.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:45.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:45.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:45.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:46.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:46.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:46.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:46.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:47.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:47.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:47.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:47.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:48.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:48.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:48.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:48.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:49.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:49.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:49.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:49.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:50.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:50.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:50.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:50.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:51.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:51.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:51.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:51.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:52.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:52.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:52.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:52.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:53.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:53.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:53.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:53.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:54.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:54.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:54.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:54.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:55.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:55.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:55.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:55.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:56.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:56.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:56.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:56.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:57.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:57.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:57.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:57.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:58.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:58.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:58.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:58.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:59.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:49:59.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:49:59.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:49:59.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:00.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:00.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:00.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:00.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:01.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:01.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:01.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:01.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:02.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:02.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:02.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:02.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:03.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:03.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:03.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:03.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:04.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:04.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:04.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:04.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:05.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:05.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:05.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:05.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:06.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:06.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:06.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:06.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:07.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:07.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:07.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:07.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:08.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:08.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:08.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:08.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:09.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:09.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:09.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:09.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:10.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:10.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:10.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:10.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:11.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:11.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:11.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:11.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:12.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:12.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:12.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:12.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:13.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:13.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:13.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:13.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:14.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:14.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:14.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:14.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:15.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:15.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:15.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:15.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:16.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:16.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:16.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:16.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:17.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:17.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:17.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:17.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:18.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:18.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:18.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:18.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:19.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:19.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:19.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:19.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:20.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:20.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:20.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:20.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:21.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:21.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:21.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:21.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:22.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:22.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:22.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:22.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:23.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:23.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:23.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:23.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:24.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:24.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:24.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:24.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:25.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:25.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:25.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:25.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:26.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:26.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:26.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:26.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:27.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:27.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:27.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:27.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:28.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:28.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:28.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:28.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:29.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:29.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:29.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:29.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:30.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:30.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:30.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:30.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:31.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:31.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:31.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:31.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:32.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:32.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:32.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:32.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:33.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:33.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:33.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:33.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:34.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:34.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:34.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:34.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:35.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:35.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:35.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:35.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:36.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:36.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:36.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:36.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:37.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:37.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:37.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:37.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:38.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:38.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:38.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:38.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:39.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:39.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:39.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:39.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:40.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:40.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:40.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:40.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:41.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:41.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:41.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:41.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:42.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:42.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:42.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:42.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:43.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:43.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:43.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:43.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:44.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:44.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:44.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:44.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:45.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:45.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:45.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:45.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:46.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:46.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:46.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:46.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:47.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:47.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:47.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:47.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:48.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:48.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:48.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:48.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:49.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:49.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:49.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:49.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:50.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:50.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:50.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:50.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:51.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:51.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:51.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:51.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:52.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:52.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:52.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:52.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:53.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:53.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:53.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:53.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:54.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:54.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:54.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:54.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:55.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:55.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:55.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:55.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:56.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:56.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:56.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:56.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:57.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:57.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:57.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:57.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:58.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:58.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:58.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:58.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:59.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:50:59.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:50:59.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:50:59.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:00.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:00.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:00.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:00.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:01.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:01.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:01.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:01.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:02.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:02.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:02.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:02.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:03.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:03.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:03.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:03.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:04.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:04.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:04.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:04.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:05.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:05.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:05.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:05.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:06.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:06.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:06.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:06.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:07.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:07.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:07.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:07.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:08.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:08.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:08.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:08.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:09.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:09.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:09.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:09.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:10.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:10.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:10.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:10.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:11.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:11.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:11.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:12.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:12.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:12.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:12.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:12.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:13.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:13.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:13.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:13.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:14.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:14.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:15.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:15.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:15.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:15.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:16.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:16.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:16.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:16.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:16.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:17.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:17.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:17.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:17.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:18.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:18.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:18.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:18.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:18.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:19.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:19.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:19.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:19.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:20.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:20.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:20.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:20.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:21.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:21.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:21.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:21.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:22.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:22.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:22.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:22.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:23.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:23.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:23.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:24.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:24.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:24.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:25.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:25.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:25.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:25.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:26.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:26.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:26.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:26.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:27.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:27.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:27.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:27.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:27.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:27.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:28.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:28.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:28.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:28.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:29.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:29.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:29.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:30.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:30.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:30.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:30.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:31.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:31.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:31.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:31.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:31.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:32.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:32.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:32.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:32.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:33.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:33.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:33.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:33.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:34.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:34.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:34.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:34.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:35.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:35.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:35.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:35.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:36.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:36.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:36.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:36.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:37.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:37.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:37.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:37.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:38.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:38.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:38.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:39.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:39.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:39.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:40.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:40.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:40.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:40.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:40.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:40.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:41.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:41.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:41.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:42.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:42.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:42.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:42.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:42.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:43.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:43.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:44.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:44.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:44.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:44.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:45.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:45.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:45.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:45.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:46.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:46.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:46.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:46.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:47.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:47.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:47.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:47.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:48.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:48.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:48.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:48.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:49.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:49.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:49.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:49.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:50.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:50.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:50.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:50.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:51.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:51.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:51.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:51.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:52.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:52.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:52.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:52.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:53.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:53.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:53.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:53.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:54.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:54.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:54.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:54.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:55.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:55.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:55.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:55.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:56.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:56.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:56.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:56.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:57.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:57.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:57.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:57.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:58.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:58.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:58.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:58.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:51:59.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:51:59.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:51:59.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:51:59.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:00.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:00.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:00.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:00.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:01.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:01.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:01.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:01.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:02.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:02.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:02.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:02.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:03.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:03.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:03.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:03.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:04.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:04.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:04.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:04.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:04.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:05.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:05.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:05.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:05.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:05.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:06.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:06.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:06.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:07.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:07.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:07.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:07.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:08.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:08.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:08.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:09.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:09.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:09.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:09.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:10.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:10.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:10.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:10.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:11.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:11.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:11.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:11.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:12.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:12.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:12.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:12.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:12.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:12.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:13.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:13.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:13.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:13.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:14.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:14.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 2 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T19:52:14.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:14.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:15.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:15.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:15.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:15.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:16.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:16.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:16.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:16.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:17.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:17.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:17.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:17.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:18.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:18.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:18.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:18.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:19.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:19.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:20.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:20.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:20.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:20.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:21.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:21.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:21.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:21.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:22.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:22.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:22.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:22.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:23.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:23.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:23.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:23.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:24.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:24.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:24.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:24.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:25.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:25.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:25.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:25.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:26.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:26.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:26.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:26.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:27.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:27.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:27.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:27.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:28.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:28.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:28.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:28.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:29.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:29.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:29.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:29.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:30.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:30.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:30.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:30.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:31.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:31.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:31.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:31.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:32.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:32.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:32.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:32.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:33.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:33.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:33.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:33.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:34.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:34.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:34.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:34.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:35.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:35.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:35.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:35.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:36.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:36.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:36.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:36.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:37.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:37.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:37.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:37.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:38.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:38.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:38.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:38.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:39.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:39.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:39.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:39.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:40.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:40.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:40.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:40.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:41.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:41.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:41.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:41.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:42.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:42.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:42.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:42.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:43.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:43.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:43.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:43.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:44.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:44.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:44.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:44.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:45.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:45.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:45.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:45.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:46.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:46.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:46.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:46.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:47.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:47.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:47.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:47.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:48.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:48.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:48.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:48.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:49.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:49.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:49.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:49.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:50.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:50.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:50.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:50.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:51.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:51.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:51.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:51.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:52.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:52.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:52.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:52.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:53.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:53.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:53.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:53.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:54.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:54.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:54.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:54.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:55.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:55.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:55.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:55.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:56.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:56.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:56.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:56.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:57.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:57.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:57.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:57.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:58.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:58.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:58.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:58.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:59.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:52:59.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:52:59.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:52:59.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:00.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:00.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:00.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:00.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:01.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:01.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:01.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:01.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:02.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:02.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:02.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:02.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:03.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:03.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:03.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:03.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:04.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:04.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:04.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:04.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:05.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:05.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:05.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:05.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:06.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:06.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:06.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:06.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:07.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:07.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:07.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:07.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:08.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:08.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:08.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:08.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:09.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:09.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:09.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:09.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:10.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:10.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:10.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:10.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:11.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:11.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:11.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:11.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:12.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:12.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:12.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:12.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:13.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:13.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:13.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:13.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:14.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:14.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:14.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:14.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:15.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:15.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:15.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:15.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:16.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:16.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:16.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:16.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:17.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:17.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:17.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:17.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:18.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:18.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:18.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:18.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:19.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:19.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:19.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:19.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:20.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:20.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:20.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:20.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:21.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:21.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:21.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:21.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:22.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:22.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:22.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:22.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:23.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:23.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:23.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:23.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:24.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:24.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:24.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:24.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:25.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:25.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:25.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:25.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:26.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:26.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:26.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:26.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:27.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:27.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:27.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:27.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:28.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:28.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:28.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:28.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:29.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:29.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:29.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:29.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:30.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:30.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:30.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:30.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:31.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:31.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:31.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:31.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:32.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:32.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:32.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:32.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:33.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:33.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:33.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:33.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:34.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:34.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:34.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:34.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:35.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:35.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:35.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:35.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:36.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:36.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:36.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:36.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:37.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:37.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:37.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:37.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:38.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:38.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:38.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:38.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:39.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:39.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:39.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:39.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:40.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:40.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:40.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:40.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:41.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:41.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:41.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:41.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:42.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:42.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:42.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:42.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:43.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:43.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:43.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:43.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:43.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:43.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:44.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:44.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:44.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:44.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:45.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:45.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:46.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:46.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:46.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:46.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:46.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:46.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:47.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:47.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:47.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:47.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:48.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:48.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:48.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:48.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:49.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:49.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:49.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:49.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:50.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:50.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:50.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:50.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:51.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:51.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:51.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:51.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:52.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:52.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:52.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:52.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:53.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:53.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:53.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:53.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:54.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:54.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:54.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:54.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:55.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:55.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:55.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:55.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:56.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:56.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:56.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:56.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:57.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:57.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:57.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:57.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:58.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:58.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:58.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:58.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:59.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:53:59.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:53:59.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:53:59.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:00.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:00.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:00.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:00.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:01.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:01.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:01.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:01.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:02.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:02.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:02.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:02.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:03.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:03.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:03.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:03.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:04.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:04.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:04.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:04.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:05.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:05.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:05.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:05.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:06.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:06.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:06.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:06.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:07.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:07.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:07.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:07.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:08.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:08.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:08.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:08.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:09.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:09.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:09.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:09.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:10.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:10.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:10.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:10.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:11.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:11.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:11.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:11.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:12.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:12.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:12.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:12.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:13.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:13.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:13.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:13.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:14.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:14.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:14.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:14.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:15.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:15.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:15.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:15.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:16.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:16.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:16.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:16.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:17.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:17.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:17.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:17.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:18.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:18.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:18.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:18.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:19.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:19.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:19.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:19.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:20.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:20.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:20.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:20.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:21.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:21.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:21.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:21.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:22.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:22.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:22.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:22.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:23.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:23.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:23.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:23.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:24.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:24.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:24.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:24.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:25.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:25.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:25.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:25.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:26.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:26.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:26.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:26.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:27.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:27.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:27.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:27.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:28.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:28.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:29.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:29.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:29.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:29.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:30.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:30.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:30.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:30.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:31.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:31.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:31.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:31.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:32.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:32.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:32.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:32.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:33.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:33.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:33.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:33.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:34.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:34.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:34.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:34.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:35.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:35.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:35.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:35.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:36.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:36.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:36.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:36.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:37.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:37.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:37.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:37.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:38.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:38.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:38.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:38.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:39.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:39.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:39.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:39.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:40.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:40.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:40.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:40.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:41.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:41.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:41.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:41.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:42.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:42.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:42.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:42.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:43.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:43.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:43.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:43.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:44.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:44.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:44.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:44.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:45.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:45.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:45.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:45.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:46.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:46.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:46.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:46.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:47.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:47.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:47.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:47.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:48.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:48.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:48.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:48.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:49.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:49.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:49.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:49.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:50.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:50.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:50.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:50.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:51.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:51.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:51.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:51.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:52.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:52.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:52.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:52.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:53.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:53.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:53.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:53.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:54.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:54.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:54.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:54.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:55.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:55.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:55.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:55.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:56.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:56.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:56.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:56.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:57.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:57.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:57.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:57.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:58.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:58.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:58.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:58.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:59.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:54:59.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:54:59.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:54:59.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:00.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:00.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:00.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:00.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:01.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:01.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:01.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:01.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:02.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:02.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:02.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:02.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:03.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:03.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:03.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:03.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:04.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:04.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:04.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:04.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:05.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:05.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:05.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:05.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:06.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:06.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:06.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:06.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:07.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:07.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:07.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:07.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:08.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:08.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:08.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:08.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:09.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:09.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:09.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:09.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:10.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:10.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:10.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:10.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:11.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:11.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:11.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:11.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:12.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:12.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:12.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:12.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:13.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:13.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:13.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:13.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:14.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:14.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:14.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:14.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:15.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:15.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:15.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:15.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:16.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:16.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:16.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:16.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:17.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:17.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:17.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:17.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:18.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:18.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:18.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:18.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:19.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:19.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:19.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:19.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:20.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:20.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:20.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:20.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:21.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:21.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:21.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:21.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:22.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:22.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:22.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:22.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:23.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:23.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:23.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:23.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:24.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:24.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:24.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:24.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:25.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:25.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:25.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:25.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:26.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:26.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:26.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:26.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:27.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:27.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:27.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:27.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:28.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:28.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:28.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:28.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:29.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:29.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:29.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:29.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:30.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:30.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:30.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:30.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:31.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:31.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:31.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:31.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:32.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:32.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:32.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:32.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:33.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:33.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:33.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:33.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:34.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:34.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:34.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:34.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:35.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:35.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:35.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:35.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:36.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:36.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:36.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:36.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:37.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:37.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:37.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:37.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:38.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:38.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:38.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:38.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:39.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:39.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:39.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:39.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:40.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:40.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:40.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:40.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:41.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:41.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:41.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:41.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:42.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:42.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:42.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:42.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:43.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:43.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:43.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:43.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:44.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:44.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:44.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:44.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:45.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:45.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:45.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:45.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:46.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:46.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:46.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:46.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:47.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:47.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:47.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:47.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:48.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:48.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:48.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:48.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:49.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:49.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:49.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:49.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:50.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:50.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:50.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:50.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:51.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:51.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:51.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:51.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:52.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:52.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:52.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:52.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:53.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:53.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:53.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:53.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:54.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:54.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:54.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:54.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:55.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:55.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:55.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:55.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:56.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:56.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:56.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:56.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:57.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:57.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:57.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:57.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:58.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:58.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:58.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:58.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:59.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:55:59.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:55:59.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:55:59.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:00.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:00.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:00.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:00.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:01.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:01.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:01.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:01.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:02.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:02.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:02.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:02.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:03.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:03.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:03.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:03.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:04.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:04.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:04.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:04.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:05.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:05.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:05.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:05.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:06.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:06.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:06.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:06.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:07.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:07.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:07.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:07.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:08.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:08.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:08.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:08.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:09.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:09.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:09.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:09.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:10.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:10.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:10.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:10.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:11.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:11.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:11.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:11.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:12.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:12.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:12.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:12.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:13.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:13.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:13.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:13.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:14.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:14.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:14.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:14.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:15.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:15.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:15.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:15.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:16.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:16.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:16.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:16.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:17.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:17.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:17.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:17.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:18.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:18.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:18.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:18.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:19.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:19.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:19.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:19.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:20.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:20.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:20.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:20.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:21.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:21.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:21.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:21.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:22.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:22.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:22.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:22.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:23.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:23.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:23.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:23.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:24.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:24.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:24.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:24.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:25.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:25.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:25.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:25.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:26.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:26.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:26.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:26.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:27.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:27.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:27.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:27.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:28.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:28.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:28.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:28.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:29.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:29.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:29.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:29.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:30.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:30.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:30.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:30.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:31.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:31.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:31.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:31.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:32.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:32.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:32.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:32.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:33.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:33.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:33.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:33.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:34.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:34.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:34.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:34.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:35.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:35.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:35.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:35.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:36.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:36.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:36.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:37.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:37.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:37.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:37.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:37.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:38.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:38.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:38.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:38.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:39.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:39.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:39.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:39.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:40.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:40.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:40.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:41.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:41.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:41.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:42.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:42.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:42.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:42.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:43.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:43.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:43.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:43.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:43.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:43.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:44.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:44.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:45.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:45.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:45.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:45.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:45.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:45.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:46.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:46.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:46.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:46.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:47.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:47.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:47.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:47.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:48.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:48.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:48.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:48.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:49.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:49.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:49.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:49.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:50.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:50.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:50.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:50.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:51.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:51.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:51.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:51.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:52.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:52.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:52.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:52.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:53.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:53.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:53.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:54.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:54.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:54.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:54.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:55.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:55.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:55.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:55.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:56.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:56.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:56.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:57.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:57.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:57.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:57.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:57.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:58.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:58.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:58.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:58.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:56:59.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:56:59.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:56:59.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:00.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:00.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:00.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:00.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:01.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:01.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:01.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:01.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:02.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:02.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:02.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:02.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:03.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:03.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:03.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:03.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:04.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:04.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:04.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:04.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:05.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:05.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:05.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:05.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:06.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:06.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:06.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:06.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:07.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:07.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:07.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:07.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:08.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:08.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:08.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:08.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:09.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:09.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:09.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:09.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:10.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:10.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:10.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:10.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:11.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:11.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:11.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:11.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:12.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:12.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:12.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:12.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:13.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:13.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:13.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:13.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:14.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:14.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:14.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:14.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:15.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:15.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:15.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:15.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:16.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:16.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:16.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:16.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:17.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:17.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:17.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:17.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:18.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:18.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:18.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:18.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:19.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:19.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:19.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:19.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:20.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:20.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:20.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:20.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:21.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:21.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:21.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:21.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:22.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:22.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:22.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:22.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:23.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:23.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:23.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:23.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:24.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:24.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:24.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:24.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:25.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:25.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:25.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:25.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:26.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:26.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:26.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:26.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:27.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:27.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:27.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:27.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:28.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:28.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:28.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:28.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:29.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:29.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:29.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:29.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:30.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:30.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:30.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:30.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:31.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:31.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:31.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:31.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:32.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:32.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:32.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:32.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:33.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:33.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:33.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:33.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:34.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:34.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:34.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:34.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:35.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:35.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:35.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:35.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:36.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:36.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:36.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:36.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:37.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:37.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:37.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:37.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:38.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:38.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:38.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:38.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:39.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:39.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:39.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:39.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:40.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:40.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:40.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:40.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:41.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:41.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:41.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:41.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:42.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:42.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:42.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:42.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:43.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:43.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:43.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:43.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:44.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:44.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:44.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:44.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:45.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:45.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:45.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:45.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:46.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:46.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:46.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:46.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:47.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:47.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:47.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:47.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:48.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:48.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:48.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:48.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:49.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:49.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:49.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:49.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:50.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:50.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:50.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:50.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:51.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:51.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:51.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:51.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:52.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:52.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:52.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:52.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:53.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:53.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:53.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:53.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:54.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:54.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:54.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:54.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:55.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:55.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:55.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:55.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:56.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:56.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:56.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:56.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:57.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:57.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:57.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:57.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:58.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:58.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:58.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:58.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:59.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:57:59.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:57:59.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:57:59.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:00.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:00.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:00.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:00.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:01.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:01.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:01.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:01.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:02.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:02.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:02.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:02.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:03.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:03.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:03.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:03.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:04.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:04.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:04.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:04.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:05.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:05.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:05.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:05.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:06.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:06.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:06.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:06.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:07.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:07.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:07.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:07.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:08.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:08.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:08.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:08.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:09.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:09.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:09.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:09.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:10.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:10.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:10.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:10.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:11.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:11.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:11.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:11.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:12.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:12.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:12.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:12.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:13.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:13.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:13.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:13.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:13.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:14.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:14.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:14.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:14.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:15.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:15.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:15.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:15.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:15.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:16.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:16.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:16.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:16.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:17.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:17.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:17.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:17.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:18.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:18.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:18.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:18.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:19.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:19.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:20.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:20.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:20.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:20.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:21.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:21.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:21.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:21.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:22.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:22.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:22.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:22.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:23.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:23.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:23.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:23.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:24.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:24.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:24.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:24.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:24.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:24.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:25.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:25.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:26.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:26.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:26.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:26.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:27.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:27.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:27.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:27.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:28.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:28.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:28.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:28.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:29.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:29.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:29.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:29.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:30.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:30.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:30.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:30.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:30.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:31.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:31.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:31.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:31.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:31.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:32.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:32.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:32.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:32.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:33.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:33.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:34.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:34.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:34.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:34.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:35.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:35.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:35.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:35.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:35.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:36.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:36.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:36.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:36.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:36.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:37.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:37.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:37.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:37.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:38.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:38.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:38.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:38.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:39.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:39.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:39.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:39.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:40.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:40.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:40.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:40.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:41.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:41.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:41.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:41.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:42.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:42.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:42.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:42.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:43.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:43.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:43.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:43.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:44.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:44.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:44.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:44.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:45.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:45.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:45.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:45.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:46.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:46.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:46.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:46.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:47.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:47.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:47.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:47.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:48.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:48.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:48.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:48.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:49.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:49.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:50.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:50.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:50.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:50.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:51.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:51.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:51.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:51.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:52.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:52.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:52.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:52.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:53.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:53.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:53.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:53.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:54.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:54.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:54.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:54.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:55.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:55.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:55.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:55.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:56.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:56.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:56.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:56.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:57.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:57.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:57.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:57.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:58.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:58.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:58.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:58.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:59.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:58:59.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:58:59.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:58:59.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:00.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:00.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:00.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:00.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:01.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:01.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:01.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:01.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:02.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:02.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:02.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:02.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:03.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:03.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:03.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:03.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:03.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:04.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:04.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:04.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:04.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:05.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:05.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:05.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:06.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:06.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:06.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:06.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:07.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:07.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:07.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:07.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:08.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:08.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:08.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:08.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:08.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:08.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:09.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:09.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:09.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:09.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:10.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:10.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:10.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:10.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:11.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:11.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:11.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:11.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:12.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:12.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:12.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:12.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:13.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:13.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:13.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:13.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:14.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:14.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:14.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:14.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:15.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:15.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:15.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:15.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:16.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:16.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:16.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:16.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:17.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:17.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:17.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:17.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:18.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:18.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:18.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:18.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:19.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:19.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:19.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:19.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:20.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:20.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:20.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:20.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:21.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:21.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:21.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:21.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:22.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:22.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:22.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:22.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:23.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:23.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:23.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:23.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:24.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:24.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:24.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:24.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:25.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:25.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:26.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:26.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:26.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:26.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:26.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:26.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:27.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:27.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:27.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:27.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:28.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:28.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:28.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:28.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:29.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:29.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:29.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:29.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:30.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:30.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:30.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:30.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:31.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:31.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:31.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:31.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:32.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:32.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:32.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:32.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:33.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:33.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:33.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:33.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:34.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:34.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:34.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:34.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:35.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:35.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:35.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:35.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:36.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:36.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:36.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:36.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:37.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:37.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:37.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:37.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:38.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:38.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:38.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:38.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:39.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:39.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:39.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:39.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:40.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:40.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:40.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:40.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:41.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:41.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:41.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:41.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:42.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:42.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:42.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:42.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:43.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:43.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:43.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:43.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:44.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:44.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:44.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:44.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:45.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:45.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:45.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:45.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:46.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:46.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:46.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:46.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:47.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:47.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:47.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:47.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:48.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:48.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:48.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:48.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:49.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:49.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:49.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:49.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:50.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:50.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:50.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:50.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:51.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:51.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:51.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:51.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:52.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:52.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:52.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:52.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:53.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:53.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:53.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:53.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:54.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:54.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:54.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:54.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:55.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:55.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:55.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:55.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:56.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:56.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:56.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:56.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:57.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:57.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:57.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:57.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:58.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:58.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:58.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:58.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:59.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T19:59:59.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T19:59:59.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T19:59:59.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:00.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:00.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:00.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:00.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:01.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:01.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:01.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:01.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:02.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:02.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:02.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:02.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:03.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:03.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:03.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:03.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:04.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:04.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:04.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:04.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:05.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:05.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:05.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:05.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:06.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:06.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:06.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:06.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:07.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:07.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:07.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:07.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:08.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:08.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:08.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:08.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:09.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:09.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:09.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:09.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:10.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:10.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:10.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:10.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:11.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:11.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:11.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:11.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:12.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:12.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:12.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:13.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:13.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:13.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:14.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:14.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:14.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:14.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:15.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:15.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:15.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:15.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:15.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:16.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:16.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:16.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:17.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:17.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:17.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:17.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:18.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:18.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:18.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:18.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:18.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:19.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:19.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:19.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:20.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:20.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:20.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:20.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:21.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:21.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:21.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:21.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:22.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:22.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:22.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:22.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:23.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:23.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:23.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:23.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:24.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:24.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:24.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:24.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:25.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:25.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:25.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:25.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:26.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:26.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:26.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:26.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:26.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:26.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:27.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:27.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:27.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:27.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:28.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:28.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:28.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:29.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:29.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:29.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:29.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:29.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:30.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:30.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:31.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:31.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:31.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:31.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:31.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:31.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:32.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:32.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:32.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:32.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:33.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:33.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:33.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:34.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:34.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:34.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:34.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:34.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:35.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:35.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:36.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:36.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:36.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:36.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:37.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:37.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:37.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:37.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:38.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:38.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:38.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:38.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:39.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:39.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:39.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:39.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:40.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:40.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:40.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:40.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:41.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:41.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:41.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:41.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:42.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:42.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:42.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:42.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:43.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:43.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:43.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:43.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:44.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:44.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:44.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:44.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:45.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:45.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:45.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:45.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:46.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:46.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:46.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:46.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:47.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:47.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:47.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:47.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:48.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:48.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:48.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:48.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:49.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:49.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:49.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:49.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:50.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:50.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:50.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:50.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:51.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:51.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:51.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:51.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:52.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:52.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:52.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:52.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:52.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:52.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:53.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:53.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:54.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:54.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:54.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:54.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:54.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:54.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:55.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:55.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:55.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:55.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:56.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:56.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:56.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:56.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:57.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:57.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:57.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:57.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:58.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:58.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:58.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:58.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:59.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:00:59.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:00:59.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:00:59.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:00.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:00.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:00.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:00.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:01.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:01.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:01.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:01.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:02.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:02.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:02.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:02.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:03.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:03.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:03.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:03.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:04.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:04.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:04.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:04.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:05.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:05.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:05.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:05.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:06.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:06.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:06.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:06.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:07.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:07.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:07.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:07.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:08.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:08.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:08.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:08.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:09.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:09.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:09.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:09.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:10.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:10.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:10.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:10.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:11.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:11.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:11.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:11.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:12.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:12.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:12.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:12.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:13.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:13.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:13.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:13.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:14.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:14.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:14.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:14.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:15.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:15.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:15.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:15.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:16.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:16.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:16.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:16.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:17.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:17.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:17.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:17.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:18.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:18.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:18.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:18.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:19.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:19.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:19.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:19.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:20.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:20.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:20.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:20.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:21.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:21.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:21.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:21.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:22.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:22.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:22.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:22.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:23.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:23.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:23.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:23.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:24.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:24.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:24.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:24.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:25.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:25.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:25.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:25.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:26.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:26.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:26.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:26.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:27.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:27.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:27.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:27.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:28.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:28.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:28.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:28.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:29.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:29.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:29.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:29.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:30.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:30.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:30.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:30.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:31.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:31.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:31.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:31.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:32.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:32.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:32.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:32.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:33.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:33.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:33.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:33.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:34.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:34.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:34.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:35.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:35.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:35.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:35.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:35.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:36.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:36.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:37.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:37.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:37.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:37.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:38.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:38.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:38.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:38.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:39.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:39.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:39.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:39.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:40.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:40.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:40.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:40.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:41.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:41.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:41.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:41.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:42.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:42.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:42.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:42.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:43.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:43.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:43.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:43.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:44.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:44.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:44.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:44.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:45.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:45.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:45.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:45.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:46.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:46.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:46.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:46.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:47.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:47.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:47.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:47.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:48.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:48.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:48.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:48.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:49.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:49.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:49.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:49.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:50.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:50.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:50.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:50.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:51.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:51.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:51.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:51.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:52.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:52.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:52.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:52.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:53.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:53.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:53.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:53.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:54.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:54.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:54.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:54.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:55.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:55.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:55.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:55.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:56.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:56.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:56.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:56.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:57.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:57.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:57.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:57.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:58.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:58.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:58.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:58.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:59.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:01:59.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:01:59.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:01:59.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:00.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:00.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:00.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:00.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:01.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:01.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:01.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:01.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:02.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:02.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:02.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:02.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:03.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:03.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:03.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:03.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:04.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:04.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:04.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:04.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:05.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:05.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:05.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:05.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:06.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:06.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:06.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:06.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:07.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:07.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:07.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:07.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:08.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:08.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:08.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:08.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:09.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:09.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:09.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:09.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:10.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:10.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:10.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:10.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:11.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:11.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:11.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:11.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:12.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:12.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:12.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:12.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:13.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:13.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:13.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:13.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:14.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:14.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:14.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:14.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:15.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:15.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:15.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:15.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:16.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:16.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:16.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:16.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:17.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:17.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:17.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:17.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:18.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:18.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:18.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:18.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:19.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:19.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:19.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:19.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:20.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:20.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:20.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:20.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:21.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:21.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:21.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:21.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:22.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:22.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:22.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:22.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:23.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:23.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:23.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:23.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:24.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:24.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 60 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:24.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:24.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:25.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:25.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:25.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:25.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:26.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:26.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:26.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:26.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:27.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:27.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:27.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:27.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:28.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:28.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:28.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:28.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:29.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:29.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:29.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:29.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:30.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:30.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:30.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:30.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:31.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:31.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:31.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:31.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:32.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:32.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:32.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:32.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:33.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:33.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:33.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:33.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:34.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:34.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:34.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:34.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:35.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:35.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:35.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:35.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:36.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:36.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:36.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:36.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:37.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:37.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:37.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:37.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:38.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:38.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:38.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:38.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:39.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:39.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:39.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:39.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:40.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:40.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:40.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:40.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:41.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:41.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:41.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:41.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:42.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:42.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:42.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:42.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:43.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:43.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:43.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:43.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:44.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:44.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:44.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:44.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:45.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:45.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:45.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:45.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:46.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:46.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:46.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:46.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:47.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:47.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:47.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:47.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:48.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:48.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:48.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:48.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:49.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:49.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:49.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:49.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:50.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:50.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:50.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:50.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:51.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:51.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:51.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:51.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:52.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:52.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:52.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:52.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:53.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:53.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:53.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:53.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:54.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:54.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 23 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:02:54.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:54.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:55.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:55.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:55.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:55.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:56.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:56.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:56.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:56.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:57.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:57.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:57.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:57.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:58.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:58.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:58.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:58.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:59.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:02:59.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:02:59.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:02:59.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:00.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:00.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:00.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:00.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:01.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:01.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:01.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:01.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:02.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:02.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:02.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:02.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:03.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:03.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:03.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:03.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:04.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:04.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:04.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:04.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:05.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:05.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:05.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:05.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:06.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:06.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:06.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:06.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:07.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:07.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:07.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:07.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:08.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:08.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:08.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:08.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:09.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:09.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:09.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:09.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:10.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:10.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:10.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:10.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:11.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:11.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:11.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:11.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:12.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:12.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:12.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:12.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:13.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:13.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:13.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:13.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:14.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:14.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:14.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:14.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:15.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:15.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:15.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:15.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:16.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:16.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:16.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:16.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:17.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:17.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:17.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:17.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:18.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:18.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:18.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:18.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:19.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:19.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:19.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:19.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:20.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:20.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:20.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:20.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:21.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:21.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:21.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:21.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:22.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:22.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:22.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:22.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:23.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:23.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:23.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:23.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:24.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:24.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:24.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:24.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:25.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:25.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:25.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:25.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:26.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:26.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:26.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:26.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:27.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:27.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:27.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:27.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:28.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:28.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:28.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:28.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:29.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:29.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:29.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:29.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:30.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:30.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:30.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:30.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:31.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:31.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:31.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:31.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:32.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:32.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:32.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:32.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:33.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:33.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:33.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:33.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:34.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:34.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:34.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:34.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:35.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:35.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:35.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:35.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:36.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:36.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:36.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:36.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:37.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:37.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:37.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:37.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:38.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:38.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:38.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:38.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:39.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:39.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:39.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:39.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:40.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:40.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:40.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:40.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:41.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:41.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:41.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:41.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:42.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:42.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:42.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:42.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:43.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:43.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:43.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:43.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:44.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:44.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:44.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:44.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:45.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:45.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:45.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:45.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:46.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:46.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:46.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:46.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:47.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:47.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:47.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:47.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:48.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:48.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:48.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:48.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:49.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:49.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:49.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:49.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:50.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:50.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:50.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:50.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:51.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:51.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:51.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:51.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:52.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:52.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:52.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:52.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:53.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:53.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:53.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:53.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:54.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:54.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:54.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:54.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:55.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:55.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:55.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:55.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:56.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:56.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:56.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:56.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:57.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:57.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:57.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:57.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:58.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:58.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:58.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:58.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:59.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:03:59.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:03:59.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:03:59.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:00.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:00.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:00.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:00.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:01.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:01.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:01.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:01.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:02.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:02.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:02.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:02.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:03.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:03.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:03.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:03.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:04.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:04.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:04.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:04.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:05.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:05.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:05.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:05.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:06.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:06.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:06.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:06.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:07.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:07.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:07.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:07.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:08.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:08.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:08.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:08.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:09.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:09.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:09.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:09.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:10.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:10.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:10.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:10.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:11.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:11.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:11.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:11.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:12.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:12.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:12.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:12.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:13.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:13.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:13.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:13.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:14.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:14.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:14.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:14.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:15.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:15.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:15.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:15.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:16.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:16.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:16.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:16.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:17.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:17.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:17.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:17.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:18.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:18.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:18.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:18.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:19.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:19.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:19.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:19.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:20.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:20.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:20.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:20.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:21.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:21.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:21.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:21.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:22.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:22.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:22.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:22.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:23.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:23.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:23.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:23.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:24.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:24.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:24.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:24.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:25.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:25.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:25.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:25.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:26.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:26.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:26.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:26.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:27.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:27.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:27.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:27.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:28.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:28.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:28.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:28.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:29.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:29.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:29.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:29.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:30.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:30.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:30.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:30.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:31.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:31.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:31.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:31.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:32.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:32.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:32.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:32.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:33.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:33.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:33.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:33.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:34.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:34.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:34.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:34.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:35.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:35.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:35.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:35.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:36.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:36.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:36.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:36.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:37.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:37.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:37.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:37.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:38.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:38.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:38.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:38.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:39.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:39.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:39.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:39.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:40.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:40.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:40.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:40.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:41.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:41.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:41.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:41.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:42.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:42.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:42.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:42.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:43.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:43.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:43.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:43.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:43.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:43.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:44.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:44.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:44.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:44.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:45.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:45.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:45.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:45.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:46.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:46.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:46.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:46.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:47.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:47.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:47.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:47.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:48.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:48.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:48.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:48.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:49.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:49.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:49.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:49.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:50.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:50.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:50.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:50.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:51.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:51.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:51.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:51.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:52.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:52.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:52.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:52.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:53.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:53.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:53.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:53.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:54.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:54.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:54.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:54.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:55.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:55.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:55.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:55.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:56.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:56.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:56.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:56.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:57.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:57.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:57.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:57.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:58.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:58.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:58.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:58.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:59.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:04:59.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:04:59.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:04:59.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:00.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:00.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:00.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:00.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:01.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:01.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:01.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:01.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:02.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:02.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:02.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:02.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:03.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:03.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:03.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:03.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:04.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:04.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:04.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:04.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:05.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:05.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:05.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:05.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:06.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:06.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:06.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:06.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:07.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:07.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:07.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:07.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:08.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:08.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:09.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:09.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:09.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:09.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:10.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:10.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:10.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:10.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:11.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:11.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:11.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:11.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:12.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:12.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:12.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:12.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:13.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:13.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:13.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:13.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:14.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:14.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:14.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:14.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:15.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:15.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:15.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:15.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:16.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:16.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:16.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:16.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:17.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:17.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:17.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:17.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:18.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:18.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:18.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:18.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:19.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:19.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:19.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:19.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:20.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:20.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:20.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:20.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:21.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:21.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:21.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:21.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:22.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:22.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:22.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:22.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:23.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:23.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:23.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:23.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:24.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:24.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:24.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:24.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:25.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:25.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:25.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:25.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:26.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:26.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:26.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:26.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:27.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:27.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:27.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:27.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:28.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:28.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:28.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:28.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:29.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:29.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:29.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:29.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:30.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:30.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:30.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:30.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:31.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:31.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:31.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:31.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:32.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:32.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:32.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:32.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:33.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:33.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:33.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:33.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:34.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:34.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:34.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:34.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:35.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:35.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:35.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:35.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:36.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:36.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:36.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:36.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:37.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:37.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:37.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:37.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:38.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:38.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:38.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:38.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:39.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:39.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:39.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:39.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:40.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:40.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:40.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:40.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:41.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:41.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:41.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:41.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:42.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:42.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:42.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:42.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:43.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:43.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:43.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:43.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:44.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:44.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:44.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:44.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:45.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:45.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:45.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:45.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:46.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:46.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:46.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:46.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:47.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:47.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:47.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:47.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:48.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:48.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:48.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:48.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:49.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:49.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:49.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:49.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:50.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:50.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:50.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:50.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:51.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:51.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:51.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:51.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:52.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:52.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:52.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:52.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:53.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:53.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:53.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:53.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:54.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:54.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:54.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:54.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:55.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:55.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:55.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:55.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:56.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:56.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:56.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:56.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:57.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:57.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:57.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:57.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:58.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:58.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:58.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:58.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:59.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:05:59.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:05:59.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:05:59.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:00.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:00.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:00.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:00.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:01.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:01.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:01.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:01.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:02.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:02.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:02.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:02.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:03.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:03.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:03.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:03.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:04.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:04.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:04.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:04.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:05.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:05.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:05.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:05.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:06.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:06.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:06.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:06.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:07.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:07.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:07.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:07.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:08.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:08.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:08.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:08.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:09.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:09.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:09.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:09.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:10.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:10.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:10.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:10.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:11.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:11.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:11.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:11.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:12.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:12.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:12.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:12.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:13.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:13.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:13.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:13.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:14.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:14.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:14.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:14.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:15.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:15.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:15.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:15.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:16.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:16.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:16.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:16.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:17.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:17.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:17.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:17.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:18.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:18.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:18.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:18.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:19.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:19.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:19.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:19.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:20.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:20.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:20.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:20.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:21.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:21.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:21.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:21.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:22.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:22.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:22.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:22.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:23.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:23.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:23.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:23.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:24.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:24.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:24.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:24.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:25.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:25.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:25.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:25.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:26.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:26.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:26.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:26.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:27.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:27.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:27.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:27.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:28.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:28.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:28.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:28.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:29.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:29.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:29.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:29.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:30.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:30.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:30.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:30.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:31.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:31.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:31.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:31.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:32.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:32.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:32.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:32.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:33.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:33.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:33.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:33.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:34.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:34.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:34.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:34.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:35.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:35.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:35.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:35.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:36.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:36.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:36.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:36.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:37.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:37.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:37.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:37.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:38.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:38.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:38.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:38.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:39.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:39.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:39.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:39.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:40.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:40.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:40.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:40.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:41.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:41.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:41.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:41.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:42.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:42.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:42.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:42.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:43.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:43.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:44.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:44.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:44.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:44.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:45.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:45.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:45.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:45.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:46.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:46.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:46.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:46.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:46.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:46.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:47.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:47.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:47.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:47.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:48.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:48.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:48.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:48.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:49.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:49.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:49.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:50.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:50.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:50.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:50.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:51.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:51.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:51.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:51.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:52.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:52.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:52.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:52.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:52.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:53.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:53.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:53.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:53.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:54.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:54.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:54.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:54.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:55.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:55.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:55.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:55.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:56.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:56.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:56.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:56.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:57.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:57.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:57.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:57.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:58.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:58.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:58.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:58.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:59.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:06:59.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:06:59.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:06:59.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:00.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:00.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:00.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:00.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:01.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:01.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:01.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:01.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:02.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:02.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:02.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:02.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:03.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:03.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:03.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:03.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:04.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:04.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:04.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:04.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:05.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:05.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:05.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:05.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:06.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:06.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:06.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:06.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:07.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:07.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:08.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:08.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:08.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:08.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:08.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:08.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:09.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:09.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:09.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:09.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:10.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:10.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:10.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:10.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:11.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:11.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:11.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:11.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:12.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:12.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:12.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:12.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:13.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:13.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:13.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:13.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:14.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:14.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:14.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:14.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:15.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:15.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:15.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:15.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:16.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:16.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:16.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:16.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:17.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:17.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:17.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:17.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:18.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:18.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:18.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:18.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:19.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:19.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:19.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:19.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:20.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:20.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:20.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:20.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:21.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:21.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:21.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:21.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:22.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:22.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:22.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:22.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:23.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:23.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:23.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:23.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:24.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:24.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:24.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:24.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:25.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:25.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:25.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:25.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:26.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:26.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:26.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:26.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:27.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:27.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:27.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:27.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:28.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:28.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:28.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:28.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:29.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:29.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:29.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:29.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:30.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:30.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:30.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:30.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:31.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:31.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:31.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:31.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:32.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:32.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:32.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:32.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:33.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:33.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:33.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:33.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:34.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:34.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:35.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:35.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:35.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:35.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:36.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:36.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:36.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:36.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:37.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:37.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:37.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:37.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:38.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:38.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:38.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:38.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:39.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:39.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:39.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:39.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:40.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:40.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:40.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:40.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:41.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:41.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:41.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:41.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:42.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:42.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:42.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:42.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:43.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:43.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:43.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:43.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:44.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:44.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:44.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:44.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:45.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:45.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:45.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:45.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:46.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:46.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:46.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:46.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:47.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:47.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:47.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:47.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:48.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:48.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:48.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:48.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:48.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:48.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:49.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:49.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:50.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:50.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:50.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:50.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:50.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:51.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:51.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:51.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:52.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:52.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:52.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:52.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:53.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:53.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:53.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:53.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:54.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:54.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:54.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:54.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:55.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:55.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:55.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:55.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:56.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:56.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:56.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:56.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:57.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:57.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:57.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:57.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:58.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:58.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:58.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:58.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:59.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:07:59.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:07:59.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:07:59.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:00.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:00.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:00.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:00.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:01.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:01.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:01.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:01.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:02.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:02.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:02.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:02.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:03.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:03.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:03.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:03.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:04.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:04.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:04.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:04.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:05.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:05.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:05.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:05.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:06.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:06.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:06.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:06.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:07.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:07.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:07.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:07.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:08.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:08.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:08.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:08.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:09.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:09.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:09.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:09.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:10.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:10.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:10.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:10.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:11.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:11.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:11.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:11.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:12.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:12.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:12.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:12.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:13.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:13.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:13.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:13.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:14.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:14.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:14.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:14.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:15.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:15.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:15.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:15.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:16.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:16.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:16.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:16.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:17.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:17.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:17.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:17.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:18.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:18.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:18.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:18.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:19.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:19.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:19.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:19.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:20.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:20.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:20.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:20.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:21.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:21.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:21.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:21.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:22.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:22.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:22.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:22.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:23.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:23.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:23.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:23.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:24.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:24.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:24.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:24.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:25.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:25.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:25.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:25.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:26.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:26.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:26.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:26.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:27.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:27.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:27.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:27.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:28.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:28.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:28.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:28.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:29.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:29.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:29.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:29.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:30.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:30.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:30.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:30.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:31.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:31.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:31.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:31.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:32.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:32.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:32.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:32.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:33.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:33.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:33.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:33.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:34.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:34.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:34.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:34.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:35.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:35.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:35.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:35.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:36.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:36.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:36.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:36.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:37.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:37.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:37.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:37.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:38.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:38.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:38.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:38.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:39.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:39.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:39.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:39.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:40.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:40.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:40.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:40.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:41.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:41.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:41.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:41.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:42.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:42.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:42.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:42.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:43.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:43.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:43.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:43.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:44.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:44.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:44.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:44.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:45.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:45.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:45.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:45.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:46.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:46.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:46.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:46.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:47.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:47.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:47.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:47.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:48.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:48.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:48.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:48.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:49.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:49.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:49.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:49.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:50.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:50.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:50.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:50.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:51.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:51.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:51.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:51.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:52.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:52.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:52.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:52.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:53.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:53.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:53.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:53.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:54.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:54.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:54.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:54.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:55.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:55.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:55.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:55.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:56.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:56.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:56.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:56.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:57.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:57.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:57.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:57.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:57.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:57.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:58.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:58.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:58.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:58.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:59.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:08:59.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:08:59.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:08:59.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:00.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:00.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:00.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:00.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:01.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:01.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:01.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:01.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:02.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:02.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:02.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:02.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:03.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:03.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:03.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:03.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:04.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:04.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:04.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:04.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:05.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:05.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:05.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:05.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:06.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:06.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:06.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:06.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:07.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:07.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:07.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:07.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:08.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:08.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:08.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:08.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:09.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:09.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:09.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:09.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:10.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:10.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:10.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:10.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:11.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:11.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:11.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:11.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:12.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:12.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:12.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:12.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:13.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:13.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:13.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:13.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:14.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:14.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:14.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:14.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:15.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:15.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:15.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:15.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:16.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:16.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:16.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:16.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:17.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:17.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:17.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:17.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:18.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:18.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:18.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:18.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:19.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:19.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:19.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:19.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:20.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:20.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:20.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:20.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:21.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:21.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:21.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:21.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:22.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:22.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:22.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:22.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:22.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:22.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:23.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:23.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:24.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:24.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:24.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:24.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:25.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:25.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:25.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:25.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:26.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:26.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:26.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:26.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:27.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:27.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:28.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:28.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:28.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:28.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:29.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:29.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:29.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:29.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:30.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:30.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:30.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:30.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:31.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:31.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:31.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:31.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:32.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:32.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:32.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:32.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:33.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:33.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:33.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:33.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:33.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:33.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:34.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:34.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:34.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:34.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:35.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:35.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:35.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:35.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:36.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:36.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:37.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:37.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:37.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:37.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:38.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:38.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:38.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:38.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:39.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:39.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:39.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:39.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:40.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:40.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:40.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:40.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:41.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:41.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:41.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:41.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:42.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:42.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:42.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:42.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:43.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:43.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:43.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:43.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:44.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:44.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:44.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:44.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:45.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:45.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:45.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:45.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:46.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:46.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:46.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:46.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:47.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:47.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:47.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:47.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:48.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:48.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:48.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:48.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:49.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:49.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:49.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:49.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:50.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:50.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:50.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:50.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:51.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:51.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:51.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:51.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:52.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:52.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:52.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:52.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:53.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:53.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:53.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:53.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:53.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:53.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:54.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:54.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:54.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:55.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:55.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:55.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:55.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:55.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:56.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:56.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:56.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:56.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:57.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:57.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:57.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:57.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:58.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:58.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:58.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:58.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:59.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:09:59.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:09:59.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:09:59.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:00.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:00.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:00.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:00.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:01.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:01.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:01.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:01.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:02.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:02.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:02.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:02.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:03.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:03.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:03.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:03.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:04.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:04.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:04.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:04.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:05.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:05.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:05.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:05.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:06.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:06.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:06.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:06.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:07.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:07.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:07.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:07.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:08.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:08.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:08.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:08.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:09.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:09.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:09.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:09.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:10.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:10.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:10.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:10.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:11.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:11.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:11.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:11.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:12.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:12.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:12.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:12.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:13.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:13.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:13.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:13.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:14.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:14.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:14.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:14.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:15.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:15.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:15.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:15.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:16.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:16.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:16.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:16.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:17.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:17.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:17.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:17.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:18.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:18.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:18.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:18.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:19.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:19.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:19.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:19.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:20.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:20.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:20.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:20.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:21.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:21.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:21.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:21.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:22.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:22.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:22.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:22.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:23.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:23.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:23.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:23.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:24.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:24.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:24.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:24.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:25.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:25.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:25.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:25.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:26.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:26.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:26.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:26.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:27.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:27.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:27.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:27.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:28.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:28.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:28.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:28.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:29.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:29.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:29.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:29.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:30.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:30.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:30.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:30.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:31.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:31.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:31.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:31.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:32.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:32.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:32.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:32.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:33.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:33.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:33.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:33.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:34.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:34.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:34.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:34.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:35.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:35.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:35.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:35.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:36.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:36.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:36.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:36.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:37.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:37.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:37.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:37.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:38.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:38.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:38.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:38.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:39.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:39.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:39.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:39.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:40.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:40.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:40.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:40.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:41.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:41.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:41.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:41.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:42.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:42.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:42.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:42.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:43.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:43.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:43.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:43.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:44.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:44.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:44.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:44.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:45.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:45.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:45.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:45.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:46.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:46.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:46.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:46.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:47.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:47.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:47.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:47.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:48.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:48.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:48.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:48.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:49.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:49.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:49.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:49.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:50.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:50.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:50.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:50.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:51.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:51.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:51.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:51.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:52.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:52.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:52.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:52.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:53.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:53.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:53.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:53.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:54.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:54.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:54.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:54.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:55.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:55.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:55.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:55.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:56.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:56.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:56.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:56.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:57.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:57.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:57.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:57.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:58.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:58.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:58.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:58.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:59.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:10:59.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:10:59.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:10:59.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:00.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:00.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:00.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:00.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:01.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:01.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:01.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:01.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:02.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:02.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:02.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:02.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:03.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:03.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:03.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:03.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:04.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:04.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:04.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:04.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:05.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:05.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:05.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:05.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:06.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:06.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:06.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:06.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:07.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:07.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:07.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:07.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:08.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:08.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:08.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:08.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:09.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:09.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:09.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:09.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:10.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:10.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:10.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:10.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:11.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:11.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:11.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:11.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:11.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:11.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:12.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:12.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:13.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:13.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:13.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:13.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:14.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:14.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:14.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:14.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:15.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:15.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:15.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:15.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:16.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:16.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:16.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:16.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:17.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:17.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:17.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:17.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:18.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:18.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:18.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:18.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:19.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:19.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:19.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:19.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:20.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:20.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:20.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:20.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:20.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:20.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:21.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:21.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:21.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:21.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:22.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:22.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:22.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:22.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:23.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:23.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:23.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:23.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:24.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:24.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:24.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:24.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:25.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:25.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:25.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:25.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:26.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:26.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:26.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:26.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:27.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:27.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:27.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:27.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:28.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:28.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:28.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:28.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:29.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:29.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:29.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:29.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:30.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:30.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:30.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:30.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:31.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:31.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:31.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:31.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:32.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:32.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:32.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:32.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:33.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:33.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:33.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:33.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:34.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:34.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:34.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:34.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:35.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:35.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:35.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:35.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:36.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:36.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:36.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:36.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:37.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:37.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:37.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:37.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:38.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:38.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:38.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:38.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:39.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:39.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:39.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:39.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:40.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:40.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:40.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:40.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:41.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:41.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:41.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:41.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:42.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:42.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:42.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:42.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:43.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:43.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:43.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:43.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:44.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:44.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:44.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:44.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:45.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:45.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:45.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:45.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:46.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:46.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:46.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:46.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:47.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:47.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:47.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:47.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:48.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:48.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:48.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:48.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:49.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:49.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:49.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:49.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:50.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:50.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:50.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:50.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:51.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:51.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:51.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:51.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:52.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:52.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:53.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:53.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:53.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:53.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:54.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:54.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:54.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:54.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:55.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:55.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:55.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:55.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:56.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:56.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:56.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:56.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:57.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:57.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:57.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:57.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:58.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:58.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:58.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:58.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:59.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:11:59.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:11:59.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:11:59.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:00.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:00.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:00.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:00.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:01.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:01.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:01.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:01.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:02.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:02.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:02.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:02.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:03.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:03.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:03.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:03.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:04.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:04.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:04.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:04.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:05.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:05.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:05.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:05.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:06.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:06.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:06.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:06.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:07.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:07.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:07.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:07.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:08.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:08.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:08.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:08.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:09.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:09.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:09.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:09.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:10.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:10.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:10.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:10.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:11.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:11.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:11.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:11.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:12.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:12.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:12.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:12.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:13.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:13.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:13.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:13.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:14.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:14.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:14.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:14.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:15.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:15.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:15.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:15.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:16.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:16.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:16.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:16.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:17.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:17.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:17.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:17.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:18.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:18.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:18.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:18.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:19.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:19.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:19.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:19.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:20.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:20.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:20.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:20.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:21.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:21.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:21.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:21.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:22.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:22.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:22.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:22.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:23.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:23.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:23.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:23.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:24.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:24.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:24.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:24.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:25.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:25.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:25.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:25.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:26.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:26.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:26.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:26.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:27.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:27.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:27.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:27.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:28.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:28.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:28.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:28.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:29.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:29.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:29.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:29.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:30.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:30.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:30.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:30.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:31.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:31.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:31.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:31.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:32.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:32.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:32.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:32.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:33.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:33.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:33.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:33.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:34.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:34.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:34.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:34.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:35.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:35.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:35.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:35.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:36.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:36.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:36.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:36.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:37.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:37.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:37.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:37.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:38.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:38.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:38.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:38.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:39.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:39.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:39.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:39.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:40.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:40.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:40.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:40.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:41.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:41.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:41.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:41.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:42.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:42.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:42.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:42.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:43.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:43.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:43.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:43.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:44.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:44.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:44.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:44.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:45.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:45.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:45.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:45.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:46.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:46.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:46.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:46.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:47.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:47.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:47.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:47.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:48.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:48.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:48.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:48.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:49.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:49.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:49.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:49.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:50.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:50.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:50.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:50.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:51.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:51.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:51.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:51.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:52.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:52.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:52.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:52.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:53.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:53.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:53.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:53.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:54.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:54.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:54.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:54.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:55.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:55.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:55.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:55.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:56.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:56.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:56.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:56.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:57.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:57.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:57.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:57.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:58.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:58.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:58.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:58.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:59.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:12:59.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:12:59.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:12:59.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:00.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:00.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:00.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:00.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:01.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:01.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:01.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:01.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:02.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:02.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:02.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:02.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:03.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:03.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:03.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:03.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:04.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:04.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:04.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:04.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:05.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:05.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:05.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:05.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:06.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:06.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:06.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:06.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:07.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:07.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:07.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:07.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:08.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:08.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:08.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:08.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:09.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:09.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:09.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:09.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:10.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:10.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:10.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:10.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:11.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:11.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:11.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:11.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:12.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:12.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:12.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:12.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:13.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:13.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:13.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:13.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:14.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:14.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:14.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:14.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:15.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:15.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:15.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:15.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:16.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:16.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:16.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:16.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:17.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:17.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:17.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:17.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:18.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:18.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:18.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:18.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:19.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:19.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:19.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:19.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:20.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:20.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:20.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:20.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:21.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:21.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:21.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:21.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:22.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:22.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:22.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:22.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:23.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:23.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:23.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:23.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:24.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:24.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:24.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:24.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:25.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:25.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:25.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:25.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:26.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:26.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:26.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:26.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:27.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:27.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:27.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:27.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:28.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:28.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:28.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:28.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:29.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:29.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:29.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:29.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:30.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:30.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:30.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:30.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:31.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:31.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:31.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:31.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:32.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:32.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:32.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:32.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:33.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:33.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:33.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:33.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:34.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:34.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:34.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:34.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:35.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:35.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:35.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:35.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:36.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:36.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:36.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:36.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:36.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:36.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:37.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:37.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:37.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:37.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:38.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:38.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:38.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:38.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:39.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:39.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:39.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:39.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:40.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:40.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:40.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:40.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:41.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:41.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:41.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:41.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:42.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:42.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:42.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:42.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:43.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:43.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:43.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:43.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:44.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:44.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:44.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:44.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:45.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:45.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:45.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:45.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:46.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:46.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:46.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:46.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:47.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:47.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:47.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:47.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:48.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:48.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:48.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:48.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:49.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:49.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:49.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:49.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:50.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:50.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:50.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:50.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:51.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:51.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:51.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:51.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:52.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:52.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:52.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:52.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:53.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:53.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:53.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:53.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:54.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:54.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:54.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:54.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:55.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:55.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:55.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:55.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:56.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:56.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:56.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:56.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:57.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:57.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:57.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:57.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:58.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:58.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:58.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:58.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:59.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:13:59.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:13:59.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:13:59.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:00.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:00.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:00.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:00.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:01.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:01.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:01.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:01.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:02.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:02.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:02.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:02.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:03.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:03.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:03.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:03.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:04.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:04.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:04.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:04.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:05.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:05.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:05.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:05.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:06.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:06.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:06.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:06.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:07.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:07.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:07.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:07.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:08.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:08.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:08.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:08.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:09.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:09.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:09.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:09.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:10.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:10.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:10.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:10.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:11.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:11.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:11.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:11.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:12.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:12.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:12.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:12.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:13.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:13.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:13.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:13.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:14.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:14.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:14.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:14.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:15.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:15.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:15.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:15.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:16.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:16.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:16.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:16.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:17.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:17.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:17.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:17.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:18.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:18.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:18.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:18.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:19.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:19.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:19.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:19.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:20.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:20.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:20.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:20.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:21.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:21.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:21.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:21.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:22.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:22.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:22.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:22.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:23.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:23.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:23.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:23.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:24.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:24.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:24.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:24.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:25.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:25.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:25.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:25.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:26.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:26.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:26.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:26.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:27.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:27.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:27.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:27.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:28.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:28.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:28.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:28.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:29.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:29.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:29.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:29.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:30.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:30.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:30.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:30.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:31.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:31.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:31.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:31.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:32.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:32.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:32.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:32.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:33.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:33.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:33.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:33.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:34.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:34.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:34.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:34.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:35.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:35.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:35.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:35.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:36.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:36.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:36.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:36.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:37.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:37.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:37.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:37.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:38.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:38.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:38.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:38.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:39.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:39.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:39.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:39.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:40.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:40.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:40.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:40.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:41.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:41.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:41.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:41.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:42.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:42.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:42.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:42.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:43.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:43.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:43.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:43.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 53 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:44.090 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T20:14:44.089+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x55ddecea29e0 msgr2=0x7f81ac040890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T20:14:44.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:44.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:44.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:44.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:45.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:45.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:45.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:45.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:46.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:46.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:46.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:46.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:47.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:47.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:47.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:47.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:48.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:48.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:48.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:48.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:49.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:49.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:49.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:49.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:50.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:50.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:50.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:50.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:51.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:51.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:51.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:51.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:52.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:52.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:52.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:52.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:53.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:53.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:53.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:53.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:54.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:54.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:54.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:54.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:55.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:55.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:55.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:55.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:56.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:56.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:56.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:56.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:57.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:57.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:57.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:57.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:58.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:58.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:58.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:58.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:59.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:14:59.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:14:59.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:14:59.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:00.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:00.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:00.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:00.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:01.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:01.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:01.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:01.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:02.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:02.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:02.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:02.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:03.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:03.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:03.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:03.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:04.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:04.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:04.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:04.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:05.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:05.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:05.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:05.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:06.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:06.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:06.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:06.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:07.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:07.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:07.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:07.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:08.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:08.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:08.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:08.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:09.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:09.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:09.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:09.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:10.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:10.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:10.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:10.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:11.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:11.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:11.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:11.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:12.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:12.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:12.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:12.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:13.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:13.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:13.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:13.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:14.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:14.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:14.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:14.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:15.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:15.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:15.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:15.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:16.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:16.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:16.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:16.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:17.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:17.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:17.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:17.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:18.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:18.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:18.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:18.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:19.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:19.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:19.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:19.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:20.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:20.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:20.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:20.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:21.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:21.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:21.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:21.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:22.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:22.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:22.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:22.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:23.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:23.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:23.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:23.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:24.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:24.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:24.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:24.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:25.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:25.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:25.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:25.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:26.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:26.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:26.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:26.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:27.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:27.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:27.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:27.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:28.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:28.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:28.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:28.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:29.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:29.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:29.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:29.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:30.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:30.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:30.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:30.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:31.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:31.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:31.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:31.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:32.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:32.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:32.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:32.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:33.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:33.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:33.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:33.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:34.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:34.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:34.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:34.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:35.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:35.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:35.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:35.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:36.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:36.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:36.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:36.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:37.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:37.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:37.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:37.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:38.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:38.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:38.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:38.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:39.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:39.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:39.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:39.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:40.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:40.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:40.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:40.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:41.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:41.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:41.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:41.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:42.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:42.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:42.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:42.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:43.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:43.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:43.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:43.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:44.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:44.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:44.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:44.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:45.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:45.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:45.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:45.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:46.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:46.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:46.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:46.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:47.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:47.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:47.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:47.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:48.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:48.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:48.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:48.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:49.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:49.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:49.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:49.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:50.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:50.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:50.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:50.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:51.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:51.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:51.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:51.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:52.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:52.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:52.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:52.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:53.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:53.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:53.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:53.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:54.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:54.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:54.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:54.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:55.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:55.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:55.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:55.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:56.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:56.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:56.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:56.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:57.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:57.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:57.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:57.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:58.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:58.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:58.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:58.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:59.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:15:59.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:15:59.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:15:59.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:00.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:00.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:00.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:00.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:01.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:01.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:01.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:01.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:02.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:02.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:02.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:02.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:03.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:03.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:03.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:03.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:04.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:04.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:04.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:04.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:05.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:05.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:05.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:05.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:06.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:06.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:06.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:06.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:07.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:07.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:07.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:07.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:08.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:08.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:08.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:08.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:09.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:09.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:09.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:09.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:10.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:10.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:10.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:10.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:11.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:11.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:11.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:11.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:12.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:12.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:12.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:12.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:13.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:13.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:13.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:13.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:14.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:14.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:14.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:14.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:15.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:15.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:15.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:15.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:16.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:16.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:16.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:16.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:17.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:17.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:17.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:17.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:18.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:18.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:18.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:18.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:19.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:19.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:19.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:19.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:20.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:20.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:20.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:20.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:21.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:21.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:21.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:21.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:22.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:22.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:22.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:22.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:23.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:23.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:23.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:23.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:24.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:24.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:24.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:24.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:25.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:25.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:25.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:25.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:26.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:26.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:26.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:26.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:27.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:27.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:27.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:27.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:28.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:28.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:28.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:28.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:29.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:29.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:29.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:29.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:30.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:30.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:30.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:30.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:31.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:31.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:31.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:31.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:32.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:32.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:32.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:32.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:33.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:33.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:33.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:33.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:34.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:34.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:34.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:34.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:35.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:35.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:35.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:35.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:36.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:36.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:36.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:36.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:37.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:37.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:37.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:37.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:38.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:38.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:38.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:38.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:39.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:39.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:39.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:39.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:40.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:40.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:40.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:40.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:41.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:41.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:41.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:41.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:42.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:42.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:42.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:42.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:43.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:43.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:43.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:43.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:44.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:44.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:44.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:44.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:45.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:45.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:45.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:45.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:46.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:46.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:46.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:46.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:47.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:47.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:47.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:47.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:48.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:48.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:48.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:48.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:49.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:49.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:49.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:49.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:50.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:50.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:50.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:50.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:51.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:51.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:51.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:51.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:52.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:52.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:52.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:52.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:53.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:53.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:53.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:53.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:54.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:54.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:54.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:54.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:55.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:55.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:55.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:55.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:56.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:56.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:56.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:56.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:57.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:57.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:57.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:57.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:58.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:58.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:58.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:58.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:59.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:16:59.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:16:59.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:16:59.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:00.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:00.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:00.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:00.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:01.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:01.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:01.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:01.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:02.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:02.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:02.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:02.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:03.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:03.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:03.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:03.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:04.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:04.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:04.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:04.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:05.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:05.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:05.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:05.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:06.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:06.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:06.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:06.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:07.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:07.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:07.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:07.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:08.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:08.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:08.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:08.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:09.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:09.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:09.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:09.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:10.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:10.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:10.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:10.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:11.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:11.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:11.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:11.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:12.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:12.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:12.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:12.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:13.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:13.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:13.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:13.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:14.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:14.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:14.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:14.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:15.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:15.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:15.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:15.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:16.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:16.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:16.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:16.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:17.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:17.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:17.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:17.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:18.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:18.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:18.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:18.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:19.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:19.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:19.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:19.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:20.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:20.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:20.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:20.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:21.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:21.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:21.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:21.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:22.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:22.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:22.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:22.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:23.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:23.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:23.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:23.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:24.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:24.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 63 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:24.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:24.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:25.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:25.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:25.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:25.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:26.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:26.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:26.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:26.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:27.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:27.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:27.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:27.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:28.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:28.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:28.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:28.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:29.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:29.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:29.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:29.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:30.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:30.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:30.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:30.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:31.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:31.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:31.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:31.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:32.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:32.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:32.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:32.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:33.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:33.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:33.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:33.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:34.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:34.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:34.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:34.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:35.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:35.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:35.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:35.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:36.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:36.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:36.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:36.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:37.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:37.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:37.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:37.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:38.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:38.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:38.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:38.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:39.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:39.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:39.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:39.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:40.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:40.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:40.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:40.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:41.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:41.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:41.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:41.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:42.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:42.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:42.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:42.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:43.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:43.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:43.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:43.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:44.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:44.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:44.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:44.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:45.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:45.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:45.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:45.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:46.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:46.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:46.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:46.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:47.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:47.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:47.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:47.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:48.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:48.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:48.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:48.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:49.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:49.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:49.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:49.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:50.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:50.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:50.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:50.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:51.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:51.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:51.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:51.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:52.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:52.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:52.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:52.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:53.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:53.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:53.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:53.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:54.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:54.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:54.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:54.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 58 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:55.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:55.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:55.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:55.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:56.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:56.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:56.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:56.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:57.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:57.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:57.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:57.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:58.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:58.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:58.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:58.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:59.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:17:59.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:17:59.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:17:59.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:00.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:00.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:00.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:00.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:01.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:01.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:01.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:01.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:02.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:02.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:02.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:02.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:03.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:03.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:03.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:03.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:04.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:04.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:04.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:04.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:05.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:05.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:05.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:05.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:06.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:06.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:06.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:06.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:07.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:07.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:07.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:07.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:08.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:08.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:08.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:08.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:09.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:09.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:09.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:09.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:10.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:10.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:10.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:10.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:11.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:11.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:11.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:11.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:12.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:12.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:12.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:12.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:13.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:13.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:13.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:13.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:14.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:14.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:14.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:14.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:15.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:15.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:15.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:15.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:16.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:16.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:16.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:16.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:17.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:17.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:17.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:17.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:18.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:18.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:18.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:18.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:19.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:19.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:19.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:19.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:20.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:20.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:20.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:20.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:21.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:21.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:21.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:21.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:22.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:22.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:23.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:23.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:23.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:23.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:24.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:24.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:24.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:24.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:25.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:25.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:25.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:25.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:26.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:26.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:26.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:26.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:27.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:27.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:27.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:27.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:28.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:28.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:28.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:28.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:29.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:29.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:29.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:29.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:29.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:29.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:30.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:30.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:31.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:31.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:31.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:31.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:31.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:31.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:32.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:32.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:33.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:33.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:33.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:33.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:34.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:34.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:34.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:34.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:35.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:35.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:35.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:35.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:36.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:36.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:36.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:36.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:37.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:37.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:37.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:37.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:38.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:38.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:38.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:38.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:39.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:39.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:39.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:39.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:40.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:40.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:40.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:40.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:41.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:41.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:41.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:41.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:42.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:42.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:42.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:42.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:43.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:43.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:43.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:43.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:44.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:44.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:44.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:44.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:45.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:45.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:45.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:45.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:46.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:46.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:46.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:46.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:47.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:47.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:47.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:47.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:48.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:48.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:48.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:48.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:49.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:49.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:49.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:49.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:50.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:50.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:50.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:50.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:51.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:51.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:51.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:51.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:52.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:52.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:52.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:52.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:53.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:53.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:53.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:53.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:54.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:54.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:54.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:54.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:55.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:55.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:55.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:55.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:56.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:56.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:56.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:56.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:57.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:57.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:57.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:57.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:58.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:58.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:58.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:58.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:59.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:18:59.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:18:59.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:18:59.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:00.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:00.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:00.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:00.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:01.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:01.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:01.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:01.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:02.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:02.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:02.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:02.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:03.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:03.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:03.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:03.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:04.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:04.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:04.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:04.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:05.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:05.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:05.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:05.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:06.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:06.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:06.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:06.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:07.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:07.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:07.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:07.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:08.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:08.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:08.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:08.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:09.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:09.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:09.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:09.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:10.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:10.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:10.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:10.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:11.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:11.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:11.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:11.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:12.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:12.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:12.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:12.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:13.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:13.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:13.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:13.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:14.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:14.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:14.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:14.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:15.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:15.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:15.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:15.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:16.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:16.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:16.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:16.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:17.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:17.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:17.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:17.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:18.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:18.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:18.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:18.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:19.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:19.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:19.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:19.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:20.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:20.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:20.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:20.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:21.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:21.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:21.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:21.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:22.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:22.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:22.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:22.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:23.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:23.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:23.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:23.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:24.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:24.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:24.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:24.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:25.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:25.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:25.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:25.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:26.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:26.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:26.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:26.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:27.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:27.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:27.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:27.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:28.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:28.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:28.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:28.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:29.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:29.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:29.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:29.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:30.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:30.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:30.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:30.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:31.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:31.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:31.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:31.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:32.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:32.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:32.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:32.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:33.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:33.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:33.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:33.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:34.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:34.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:34.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:34.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:35.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:35.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:35.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:35.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:36.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:36.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:36.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:36.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:37.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:37.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:37.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:37.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:38.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:38.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:38.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:38.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:39.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:39.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:39.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:39.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:40.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:40.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:40.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:40.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:41.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:41.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:41.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:41.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:42.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:42.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:42.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:42.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:43.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:43.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:43.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:43.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:44.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:44.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:44.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:44.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:45.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:45.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:45.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:45.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:46.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:46.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:46.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:46.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:47.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:47.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:47.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:47.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:48.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:48.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:48.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:48.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:49.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:49.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:49.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:49.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:50.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:50.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:50.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:50.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:51.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:51.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:51.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:51.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:52.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:52.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:52.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:52.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:53.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:53.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:53.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:53.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:54.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:54.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:54.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:54.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:55.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:55.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:55.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:55.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:56.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:56.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:56.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:56.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:57.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:57.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:57.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:57.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:58.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:58.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:58.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:58.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:59.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:19:59.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:19:59.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:19:59.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:00.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:00.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:00.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:00.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:01.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:01.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:01.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:01.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:02.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:02.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:02.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:02.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:03.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:03.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:03.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:03.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:04.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:04.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:04.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:04.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:05.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:05.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:05.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:05.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:06.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:06.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:06.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:06.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:07.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:07.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:07.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:07.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:08.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:08.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:08.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:08.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:09.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:09.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:09.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:09.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:10.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:10.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:10.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:10.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:11.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:11.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:11.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:11.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:12.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:12.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:12.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:12.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:13.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:13.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:13.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:13.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:14.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:14.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:14.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:14.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:15.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:15.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:15.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:15.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:16.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:16.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:16.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:16.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:17.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:17.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:17.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:17.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:18.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:18.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:18.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:18.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:19.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:19.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:19.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:19.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:20.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:20.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:20.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:20.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:21.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:21.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:21.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:21.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:22.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:22.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:22.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:22.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:23.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:23.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:23.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:23.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:24.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:24.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:24.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:24.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:25.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:25.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:25.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:25.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:26.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:26.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:26.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:26.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:27.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:27.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:27.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:27.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:28.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:28.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:28.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:28.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:29.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:29.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:29.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:29.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:30.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:30.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:30.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:30.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:31.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:31.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:31.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:31.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:32.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:32.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:32.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:32.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:33.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:33.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:33.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:33.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:34.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:34.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:34.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:34.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:35.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:35.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:35.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:35.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:36.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:36.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:36.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:36.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:37.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:37.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:37.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:37.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:38.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:38.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:38.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:38.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:39.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:39.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:39.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:39.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:40.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:40.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:40.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:40.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:41.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:41.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:41.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:41.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:42.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:42.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:42.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:42.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:43.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:43.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:43.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:43.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:44.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:44.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:44.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:44.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:45.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:45.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:45.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:45.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:46.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:46.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:46.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:46.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:47.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:47.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:47.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:47.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:48.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:48.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:48.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:48.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:49.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:49.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:49.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:49.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:50.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:50.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:50.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:50.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:51.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:51.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:51.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:51.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:52.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:52.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:52.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:52.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:53.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:53.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:53.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:53.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:54.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:54.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:54.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:54.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:55.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:55.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:55.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:55.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:56.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:56.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:56.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:56.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:57.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:57.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:58.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:58.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:58.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:58.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:58.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:58.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:59.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:20:59.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:20:59.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:20:59.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:00.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:00.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:00.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:00.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:01.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:01.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:01.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:01.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:02.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:02.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:02.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:02.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:03.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:03.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:03.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:03.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:04.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:04.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:04.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:04.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:05.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:05.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:05.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:05.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:06.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:06.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:06.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:06.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:07.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:07.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:07.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:07.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:08.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:08.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:08.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:08.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:09.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:09.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:09.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:09.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:10.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:10.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:10.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:10.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:11.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:11.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:11.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:11.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:12.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:12.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:12.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:12.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:13.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:13.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:13.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:13.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:14.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:14.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:14.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:14.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:15.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:15.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:15.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:15.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:16.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:16.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:16.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:16.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:17.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:17.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:17.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:17.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:18.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:18.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:18.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:18.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:19.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:19.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:19.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:19.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:20.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:20.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:20.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:20.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:21.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:21.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:21.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:21.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:22.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:22.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:22.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:22.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:23.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:23.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:23.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:23.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:24.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:24.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:24.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:24.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:25.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:25.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:25.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:25.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:26.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:26.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:26.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:26.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:27.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:27.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:27.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:27.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:28.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:28.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:28.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:28.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:29.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:29.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:29.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:29.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:30.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:30.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:30.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:30.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:31.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:31.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:31.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:31.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:32.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:32.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:32.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:32.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:33.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:33.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:33.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:33.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:34.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:34.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:34.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:34.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:35.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:35.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:35.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:35.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:36.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:36.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:36.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:36.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:37.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:37.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:37.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:37.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:38.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:38.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:38.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:38.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:39.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:39.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:40.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:40.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:40.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:40.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:40.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:40.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:41.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:41.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:41.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:41.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:42.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:42.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:42.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:42.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:43.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:43.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:44.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:44.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:44.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:44.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:44.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:44.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:45.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:45.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:45.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:45.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:46.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:46.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:46.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:46.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:47.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:47.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:47.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:47.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:48.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:48.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:48.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:48.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:49.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:49.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:49.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:49.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:50.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:50.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:50.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:50.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:51.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:51.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:51.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:51.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:52.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:52.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:52.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:52.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:53.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:53.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:53.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:53.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:54.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:54.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:54.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:54.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:55.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:55.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:55.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:55.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:56.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:56.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:56.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:56.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:57.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:57.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:57.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:57.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:58.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:58.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:58.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:58.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:59.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:21:59.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:21:59.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:21:59.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:00.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:00.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:00.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:00.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:01.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:01.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:01.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:01.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:02.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:02.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:02.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:02.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:03.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:03.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:03.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:03.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:04.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:04.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:04.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:04.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:05.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:05.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:05.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:05.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:06.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:06.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:06.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:06.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:07.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:07.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:07.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:07.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:08.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:08.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:08.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:08.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:09.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:09.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:09.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:09.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:10.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:10.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:10.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:10.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:11.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:11.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:12.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:12.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:12.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:12.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:12.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:12.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:13.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:13.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:13.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:13.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:14.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:14.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:15.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:15.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:15.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:15.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:16.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:16.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:16.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:16.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:17.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:17.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:17.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:17.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:18.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:18.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:18.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:18.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:19.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:19.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:19.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:19.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:20.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:20.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:20.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:20.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:21.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:21.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:21.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:21.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:22.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:22.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:22.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:22.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:23.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:23.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:23.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:23.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:23.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:23.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:24.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:24.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:25.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:24.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:25.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:25.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:25.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:25.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:26.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:26.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:26.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:26.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:27.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:27.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:27.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:27.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:28.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:28.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:28.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:28.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:29.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:29.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:29.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:29.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:30.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:30.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:30.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:30.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:31.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:31.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:32.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:32.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:32.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:32.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:32.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:32.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:33.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:33.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:33.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:33.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:34.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:34.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:34.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:34.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:35.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:35.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:35.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:35.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:36.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:36.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:36.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:36.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:37.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:37.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:37.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:37.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:38.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:38.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:38.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:38.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:39.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:39.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:40.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:39.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:40.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:40.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:40.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:40.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:41.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:41.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:41.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:41.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:42.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:42.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:42.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:42.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:43.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:43.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:44.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:44.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:44.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:44.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:44.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:44.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:45.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:45.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:45.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:45.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:46.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:46.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:46.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:46.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:47.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:47.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:48.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:48.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:48.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:48.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:49.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:49.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:49.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:49.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:50.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:50.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:50.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:50.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:51.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:51.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:51.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:51.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:52.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:52.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:52.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:52.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:53.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:53.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:53.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:53.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:54.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:54.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:54.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:54.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:55.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:55.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:55.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:55.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:56.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:56.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:56.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:56.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:57.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:57.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:57.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:57.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:58.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:58.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:58.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:58.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:59.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:22:59.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:22:59.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:22:59.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:00.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:00.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:00.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:00.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:01.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:01.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:01.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:01.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:02.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:02.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:02.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:02.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:03.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:03.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:03.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:03.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:04.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:04.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:04.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:04.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:05.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:05.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:05.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:05.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:06.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:06.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:06.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:06.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:07.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:07.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:07.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:07.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:07.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:07.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:08.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:08.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:09.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:09.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:09.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:09.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:10.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:10.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:10.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:10.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:11.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:11.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:12.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:12.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:12.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:12.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:13.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:12.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:13.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:13.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:13.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:13.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:14.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:14.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:14.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:14.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:15.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:15.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:15.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:15.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:16.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:16.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:17.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:17.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:17.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:17.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:17.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:17.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:18.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:18.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:18.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:18.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:19.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:19.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:19.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:19.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:20.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:20.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:20.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:20.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:21.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:21.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:21.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:21.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:22.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:22.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:22.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:22.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:23.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:23.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:23.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:23.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:24.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:24.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:24.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:24.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:25.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:25.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:25.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:25.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:26.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:26.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:26.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:26.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:27.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:27.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:27.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:27.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:28.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:28.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:28.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:28.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:29.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:29.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:29.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:29.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:30.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:30.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:30.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:30.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:31.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:31.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:31.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:31.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:32.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:32.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:32.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:32.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:33.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:33.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:33.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:33.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:34.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:34.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:34.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:34.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:35.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:35.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:35.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:35.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:36.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:36.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:36.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:36.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:37.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:37.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:37.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:37.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:38.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:38.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:38.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:38.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:39.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:39.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:39.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:39.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:40.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:40.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:40.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:40.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:41.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:41.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:41.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:41.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:42.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:41.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:42.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:42.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:42.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:42.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:43.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:43.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:43.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:43.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:44.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:44.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:44.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:44.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:45.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:45.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:45.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:45.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:46.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:46.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:46.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:46.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:47.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:47.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:47.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:47.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:48.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:48.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:48.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:48.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:49.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:49.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:49.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:49.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:50.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:50.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:50.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:50.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:51.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:51.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:51.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:51.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:52.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:52.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:52.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:52.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:53.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:53.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:53.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:53.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:54.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:54.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:54.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:54.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:55.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:55.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:55.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:55.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:56.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:56.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:56.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:56.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:57.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:57.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:57.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:57.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:58.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:58.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:58.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:58.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:59.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:23:59.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:23:59.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:23:59.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:00.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:00.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:00.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:00.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:01.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:01.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:01.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:01.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:02.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:02.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:02.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:02.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:03.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:03.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:03.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:03.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:04.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:04.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:04.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:04.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:05.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:05.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:05.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:05.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:06.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:06.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:06.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:06.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:07.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:07.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:07.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:07.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:08.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:08.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:08.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:08.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:09.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:09.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:09.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:09.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:10.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:10.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:10.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:10.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:11.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:11.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:11.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:11.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:12.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:12.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:12.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:12.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:13.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:13.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:13.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:13.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:14.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:14.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:14.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:14.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:15.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:15.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:15.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:15.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:16.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:16.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:16.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:16.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:17.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:17.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:17.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:17.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:18.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:18.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:18.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:18.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:19.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:19.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:19.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:19.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:20.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:20.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:20.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:20.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:21.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:21.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:21.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:21.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:22.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:22.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:22.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:22.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:23.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:23.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:23.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:23.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:24.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:24.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:25.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:25.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:25.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:25.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:25.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:25.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:26.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:26.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:27.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:27.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:27.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:27.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:28.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:28.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:28.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:28.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:29.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:29.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:29.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:29.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:29.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:29.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:30.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:30.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:30.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:30.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:31.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:31.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:31.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:31.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:32.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:32.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:32.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:32.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:33.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:33.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:33.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:33.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:34.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:34.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:34.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:34.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:35.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:35.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:35.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:35.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:36.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:36.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:36.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:36.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:37.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:37.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:37.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:37.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:38.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:38.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:38.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:38.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:39.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:39.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:39.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:39.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:40.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:40.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:40.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:40.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:41.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:41.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:41.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:41.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:42.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:42.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:42.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:42.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:43.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:43.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:43.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:43.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:44.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:44.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:44.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:44.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:45.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:45.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:45.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:45.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:46.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:46.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:46.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:46.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:47.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:47.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:47.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:47.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:48.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:48.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:48.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:48.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:49.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:49.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:49.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:49.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:50.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:50.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:50.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:50.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:51.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:51.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:51.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:51.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:52.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:52.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:52.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:52.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:53.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:53.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:53.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:53.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:54.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:54.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:54.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:54.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:55.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:55.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:55.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:55.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:56.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:56.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:56.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:56.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:57.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:57.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:57.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:57.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:58.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:58.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:58.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:58.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:59.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:24:59.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:24:59.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:24:59.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:00.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:00.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:00.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:00.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:01.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:01.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:01.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:01.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:02.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:02.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:02.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:02.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:03.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:03.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:03.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:03.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:04.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:04.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:04.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:04.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:05.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:05.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:05.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:05.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:06.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:06.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:06.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:06.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:07.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:07.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:07.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:07.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:08.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:08.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:08.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:08.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:09.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:09.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:09.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:09.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:10.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:10.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:10.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:10.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:11.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:11.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:11.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:11.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:12.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:12.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:12.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:12.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:13.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:13.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:13.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:13.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:14.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:14.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:14.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:14.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:15.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:15.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:15.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:15.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:16.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:16.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:16.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:16.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:17.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:17.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:17.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:17.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:18.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:18.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:18.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:18.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:19.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:19.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:19.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:19.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:20.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:20.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:20.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:20.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:21.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:21.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:21.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:21.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:22.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:22.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:22.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:22.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:23.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:23.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:23.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:23.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:24.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:24.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:24.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:24.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:25.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:25.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:25.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:25.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:26.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:26.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:26.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:26.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:27.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:27.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:27.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:27.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:28.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:28.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:28.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:28.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:29.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:29.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:29.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:29.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:30.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:30.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:30.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:30.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:31.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:31.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:31.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:31.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:32.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:32.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:32.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:32.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:33.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:33.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:33.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:33.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:34.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:34.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:35.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:35.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:35.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:35.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:35.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:35.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:36.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:36.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:36.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:36.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:37.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:37.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:37.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:37.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:38.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:38.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:38.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:38.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:39.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:39.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:39.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:39.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:40.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:40.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:40.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:40.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:41.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:41.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:41.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:41.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:42.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:42.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:42.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:42.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:43.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:43.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:43.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:43.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:44.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:44.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:44.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:44.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:45.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:45.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:45.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:45.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:46.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:46.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:46.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:46.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:47.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:47.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:47.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:47.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:48.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:48.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:48.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:48.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:49.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:49.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:49.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:49.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:50.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:50.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:50.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:50.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:51.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:51.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:51.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:51.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:52.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:52.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:52.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:52.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:53.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:53.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:53.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:53.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:54.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:54.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:54.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:54.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:55.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:55.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:55.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:55.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:56.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:56.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:56.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:56.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:57.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:57.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:58.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:58.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:58.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:58.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:59.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:25:59.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:25:59.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:25:59.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:00.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:00.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:00.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:00.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:01.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:01.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:01.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:01.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:02.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:02.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:02.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:02.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:03.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:03.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:03.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:03.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:04.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:04.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:04.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:04.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:05.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:05.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:05.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:05.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:06.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:06.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:06.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:06.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:07.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:07.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:07.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:07.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:08.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:08.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:08.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:08.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:09.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:09.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:09.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:09.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:10.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:10.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:10.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:10.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:10.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:10.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:11.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:11.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:12.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:12.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:12.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:12.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:13.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:13.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:13.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:13.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:14.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:14.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:14.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:14.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:15.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:15.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:15.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:15.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:16.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:16.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:16.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:16.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:17.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:17.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:17.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:17.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:18.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:18.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:18.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:18.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:18.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:18.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:19.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:19.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:19.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:19.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:20.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:20.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:20.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:20.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:21.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:21.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:21.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:21.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:22.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:22.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:22.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:22.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:23.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:23.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:24.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:24.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:24.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:24.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:25.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:25.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:25.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:25.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:26.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:26.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:26.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:26.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:27.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:27.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:27.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:27.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:28.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:28.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:28.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:28.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:29.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:29.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:29.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:29.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:30.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:30.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:30.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:30.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:31.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:31.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:31.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:31.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:32.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:32.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:32.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:32.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:33.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:33.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:33.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:33.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:34.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:34.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:34.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:34.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:35.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:35.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:35.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:35.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:36.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:36.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:36.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:36.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:37.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:37.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:37.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:37.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:38.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:38.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:38.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:38.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:39.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:39.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:39.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:39.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:40.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:40.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:40.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:40.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:40.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:40.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:41.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:41.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:41.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:41.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:42.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:42.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:42.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:42.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:43.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:43.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:43.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:43.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:44.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:44.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:44.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:44.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:45.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:45.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:45.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:45.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:46.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:46.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:46.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:46.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:47.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:47.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:47.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:47.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:48.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:48.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:48.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:48.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:49.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:49.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:49.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:49.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:50.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:50.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:50.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:50.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:51.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:51.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:52.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:52.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:52.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:52.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:53.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:53.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:53.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:53.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:53.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:53.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:54.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:54.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:54.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:54.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:55.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:55.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:55.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:55.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:56.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:56.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:56.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:56.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:57.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:57.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:57.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:57.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:58.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:58.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:58.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:58.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:59.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:26:59.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:26:59.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:26:59.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:00.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:00.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:00.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:00.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:01.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:01.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:01.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:01.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:02.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:02.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:02.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:02.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:03.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:03.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:03.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:03.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:04.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:04.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:04.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:04.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:05.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:05.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:05.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:05.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:06.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:06.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:06.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:06.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:07.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:07.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:07.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:07.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:08.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:08.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:08.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:08.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:09.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:09.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:09.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:09.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:10.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:10.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:10.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:10.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:11.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:11.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:11.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:11.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:12.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:12.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:12.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:12.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:13.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:13.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:13.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:13.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:14.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:14.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:14.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:14.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:15.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:15.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:15.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:15.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:16.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:16.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:16.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:16.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:17.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:17.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:17.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:17.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:18.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:18.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:18.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:18.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:19.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:19.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:19.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:19.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:20.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:20.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:20.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:20.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:21.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:21.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:21.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:21.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:22.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:22.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:22.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:22.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:23.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:23.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:23.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:23.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:24.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:24.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:24.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:24.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:25.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:25.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:25.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:25.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:26.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:26.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:26.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:26.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:27.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:27.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:27.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:27.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:28.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:28.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:28.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:28.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:29.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:29.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:29.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:29.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:30.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:30.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:30.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:30.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:31.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:31.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:31.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:31.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:32.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:32.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:32.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:32.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:33.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:33.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:33.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:33.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:34.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:34.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:34.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:34.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:35.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:35.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:35.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:35.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:36.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:36.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:36.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:36.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:37.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:37.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:37.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:37.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:38.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:38.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:38.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:38.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:39.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:39.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:39.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:39.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:40.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:40.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:40.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:40.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:41.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:41.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:41.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:41.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:42.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:42.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:42.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:42.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:43.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:43.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:43.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:43.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:44.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:44.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:44.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:44.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:45.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:45.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:45.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:45.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:46.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:46.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:46.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:46.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:47.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:47.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:47.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:47.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:48.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:48.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:48.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:48.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:49.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:49.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:49.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:49.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:50.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:50.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:50.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:50.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:51.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:51.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:51.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:51.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:52.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:52.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:52.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:52.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:53.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:53.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:53.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:53.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:54.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:54.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:54.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:54.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:55.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:55.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:55.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:55.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:56.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:56.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:56.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:56.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:57.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:57.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:57.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:57.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:58.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:58.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:58.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:58.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:59.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:27:59.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:27:59.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:27:59.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:00.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:00.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:00.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:00.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:01.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:01.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:01.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:01.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:02.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:02.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:02.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:02.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:03.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:03.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:03.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:03.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:04.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:04.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:04.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:04.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:05.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:05.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:05.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:05.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:06.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:06.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:06.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:06.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:07.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:07.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:07.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:07.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:08.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:08.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:08.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:08.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:09.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:09.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:09.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:09.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:10.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:10.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:10.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:10.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:11.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:11.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:11.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:11.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:12.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:12.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:12.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:12.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:13.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:13.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:13.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:13.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:14.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:14.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:14.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:14.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:15.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:15.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:15.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:15.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:16.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:16.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:16.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:16.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:17.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:17.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:17.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:17.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:18.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:18.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:18.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:18.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:19.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:19.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:19.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:19.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:20.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:20.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:20.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:20.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:21.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:21.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:21.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:21.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:22.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:22.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:22.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:22.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:23.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:23.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:23.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:23.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:24.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:24.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:24.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:24.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:25.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:25.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:25.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:25.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:26.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:26.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:26.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:26.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:27.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:27.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:27.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:27.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:28.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:28.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:28.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:28.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:29.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:29.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:29.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:29.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:30.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:30.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:30.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:30.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:31.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:31.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:31.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:31.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:32.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:32.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:32.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:32.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:33.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:33.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:33.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:33.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:34.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:34.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:34.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:34.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:35.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:35.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:35.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:35.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:36.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:36.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:36.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:36.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:37.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:37.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:37.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:37.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:38.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:38.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:38.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:38.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:39.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:39.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:39.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:39.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:40.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:40.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:40.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:40.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:41.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:41.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:41.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:41.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:42.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:42.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:42.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:42.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:43.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:43.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:43.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:43.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:44.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:44.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:44.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:44.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:45.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:45.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:45.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:45.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:46.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:46.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:46.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:46.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:47.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:47.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:47.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:47.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:48.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:48.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:48.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:48.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:49.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:49.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:49.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:49.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:50.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:50.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:50.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:50.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:51.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:51.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:51.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:51.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:52.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:52.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:52.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:52.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:53.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:53.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:53.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:53.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:54.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:54.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:54.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:54.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:55.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:55.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:55.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:55.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:56.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:56.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:56.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:56.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:57.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:57.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:57.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:57.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:58.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:58.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:58.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:58.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:59.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:28:59.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:28:59.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:28:59.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:00.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:00.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:00.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:00.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:01.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:01.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:01.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:01.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:02.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:02.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:02.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:02.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:03.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:03.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:03.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:03.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:04.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:04.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:04.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:04.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:05.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:05.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:05.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:05.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:06.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:06.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:06.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:06.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:07.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:07.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:07.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:07.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:08.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:08.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:08.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:08.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:09.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:09.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:09.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:09.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:10.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:10.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:10.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:10.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:11.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:11.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:11.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:11.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:12.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:12.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:12.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:12.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:13.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:13.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:13.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:13.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:14.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:14.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:14.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:14.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:15.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:15.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:15.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:15.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:16.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:16.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:16.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:16.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:17.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:17.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:17.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:17.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:18.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:18.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:18.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:18.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:19.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:19.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:19.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:19.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:20.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:20.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:20.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:20.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:21.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:21.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:21.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:21.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:22.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:22.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:22.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:22.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:23.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:23.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:23.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:23.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:24.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:24.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:24.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:24.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:25.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:25.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:25.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:25.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:26.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:26.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:26.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:26.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:27.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:27.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:27.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:27.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:28.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:28.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:28.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:28.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:29.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:29.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:29.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:29.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:30.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:30.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:30.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:30.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:31.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:31.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:31.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:31.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:32.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:32.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:32.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:32.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:33.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:33.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:33.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:33.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:34.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:34.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:34.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:34.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:35.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:35.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:35.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:35.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:36.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:36.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:36.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:36.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:37.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:37.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:37.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:37.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:38.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:38.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:38.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:38.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:39.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:39.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:39.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:39.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:40.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:40.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:40.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:40.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:41.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:41.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:41.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:41.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:42.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:42.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:42.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:42.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:43.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:43.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:43.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:43.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:44.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:44.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:44.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:44.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:45.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:45.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:45.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:45.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:46.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:46.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:46.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:46.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:47.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:47.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:47.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:47.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:48.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:48.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:48.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:48.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:49.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:49.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:49.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:49.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:50.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:50.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:50.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:50.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:51.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:51.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:51.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:51.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:52.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:52.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:52.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:52.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:53.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:53.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:53.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:53.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:54.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:54.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:54.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:54.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:55.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:55.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:55.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:55.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:56.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:56.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:56.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:56.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:57.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:57.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:57.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:57.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:58.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:58.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:58.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:58.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:59.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:29:59.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:29:59.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:29:59.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:00.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:00.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:00.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:00.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:01.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:01.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:01.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:01.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:02.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:02.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:02.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:02.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:03.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:03.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:03.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:03.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:04.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:04.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:04.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:04.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:05.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:05.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:05.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:05.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:06.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:06.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:06.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:06.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:07.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:07.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:07.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:07.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:08.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:08.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:08.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:08.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:09.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:09.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:09.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:09.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:10.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:10.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:10.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:10.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:11.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:11.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:11.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:11.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:12.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:12.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:12.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:12.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:13.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:13.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:13.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:13.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:14.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:14.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:14.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:14.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:15.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:15.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:16.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:16.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:16.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:16.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:17.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:17.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:17.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:17.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:18.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:18.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:18.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:18.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:19.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:19.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:19.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:19.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:20.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:20.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:20.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:20.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:21.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:21.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:21.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:21.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:22.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:22.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:22.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:22.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:23.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:23.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:23.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:23.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:24.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:24.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:24.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:24.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:25.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:25.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:25.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:25.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:26.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:26.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:26.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:26.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:27.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:27.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:27.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:27.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:28.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:28.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:28.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:28.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:29.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:29.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:29.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:29.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:30.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:30.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:30.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:30.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:31.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:31.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:31.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:31.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:32.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:32.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:32.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:32.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:33.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:33.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:33.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:33.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:34.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:34.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:34.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:34.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:35.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:35.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:35.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:35.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:36.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:36.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:36.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:36.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:37.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:37.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:37.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:37.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:38.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:38.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:38.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:38.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:39.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:39.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:39.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:39.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:40.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:40.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:40.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:40.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:41.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:41.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:41.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:41.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:42.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:42.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:42.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:42.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:43.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:43.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:43.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:43.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:44.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:44.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:44.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:44.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:45.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:45.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:45.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:45.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:46.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:46.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:46.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:46.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:47.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:47.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:47.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:47.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:48.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:48.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:48.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:48.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:49.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:49.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:49.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:49.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:50.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:50.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:50.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:50.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:51.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:51.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:51.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:51.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:52.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:52.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:52.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:52.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:53.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:53.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:53.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:53.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:54.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:54.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:54.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:54.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:55.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:55.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:55.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:55.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:56.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:56.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:56.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:56.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:57.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:57.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:57.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:57.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:58.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:58.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:58.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:58.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:59.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:30:59.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:30:59.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:30:59.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:00.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:00.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:00.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:00.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:01.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:01.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:01.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:01.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:02.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:02.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:02.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:02.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:03.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:03.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:03.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:03.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:04.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:04.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:04.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:04.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:05.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:05.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:05.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:05.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:06.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:06.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:06.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:06.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:07.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:07.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:07.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:07.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:08.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:08.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:08.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:08.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:09.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:09.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:09.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:09.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:10.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:10.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:10.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:10.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:11.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:11.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:11.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:11.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:12.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:12.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:12.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:12.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:13.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:13.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:13.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:13.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:14.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:14.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:14.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:14.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:15.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:15.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:15.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:15.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:16.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:16.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:16.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:16.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:17.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:17.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:17.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:17.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:18.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:18.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:18.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:18.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:19.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:19.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:19.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:19.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:20.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:20.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:20.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:20.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:21.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:21.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:21.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:21.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:22.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:22.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:22.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:22.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:23.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:23.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:23.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:23.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:24.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:24.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:24.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:24.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:25.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:25.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:25.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:25.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:26.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:26.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:26.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:26.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:27.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:27.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:27.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:27.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:28.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:28.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:28.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:28.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:29.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:29.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:29.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:29.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:30.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:30.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:30.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:30.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:31.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:31.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:31.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:31.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:32.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:32.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:32.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:32.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:33.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:33.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:33.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:33.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:34.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:34.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:34.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:34.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:35.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:35.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:35.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:35.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:36.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:36.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:36.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:36.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:37.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:37.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:37.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:37.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:38.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:38.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:38.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:38.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:39.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:39.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:39.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:39.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:40.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:40.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:40.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:40.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:41.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:41.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:41.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:41.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:42.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:42.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:42.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:42.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:43.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:43.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:43.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:43.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:44.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:44.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:44.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:44.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:45.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:45.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:45.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:45.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:46.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:46.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:46.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:46.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:47.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:47.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:47.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:47.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:48.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:48.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:48.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:48.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:49.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:49.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:49.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:49.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:50.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:50.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:50.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:50.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:51.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:51.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:51.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:51.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:52.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:52.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:52.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:52.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:53.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:53.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:53.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:53.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:54.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:54.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:54.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:54.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:55.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:55.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:55.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:55.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:56.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:56.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:56.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:56.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:57.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:57.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:57.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:57.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:58.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:58.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:58.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:58.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:59.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:31:59.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:31:59.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:31:59.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:00.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:00.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:00.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:00.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:01.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:01.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:01.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:01.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:02.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:02.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:02.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:02.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:03.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:03.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:03.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:03.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:04.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:04.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:04.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:04.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:05.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:05.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:05.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:05.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:06.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:06.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:06.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:06.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:07.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:07.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:07.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:07.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:08.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:08.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:08.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:08.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:09.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:09.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:09.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:09.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:10.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:10.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:10.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:10.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:11.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:11.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:11.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:11.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:12.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:12.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:12.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:12.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:13.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:13.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:13.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:13.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:14.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:14.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:14.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:14.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:15.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:15.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:15.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:15.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:16.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:16.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:16.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:16.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:17.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:17.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:17.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:17.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:18.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:18.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:18.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:18.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:19.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:19.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:19.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:19.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:20.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:20.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:20.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:20.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:21.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:21.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:21.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:21.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:22.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:22.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:22.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:22.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:23.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:23.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:23.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:23.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:24.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:24.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:24.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:24.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 66 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:25.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:25.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:25.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:25.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:26.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:26.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:26.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:26.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:27.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:27.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:27.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:27.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:28.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:28.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:28.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:28.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:29.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:29.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:29.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:29.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:30.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:30.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:30.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:30.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:31.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:31.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:31.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:31.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:32.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:32.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:32.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:32.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:33.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:33.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:33.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:33.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:34.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:34.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:34.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:34.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:35.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:35.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:35.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:35.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:36.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:36.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:36.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:36.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:37.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:37.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:37.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:37.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:38.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:38.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:38.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:38.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:39.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:39.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:39.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:39.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:40.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:40.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:40.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:40.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:41.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:41.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:41.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:41.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:42.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:42.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:42.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:42.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:43.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:43.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:43.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:43.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:44.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:44.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:44.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:44.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:45.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:45.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:45.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:45.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:46.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:46.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:46.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:46.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:47.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:47.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:47.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:47.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:48.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:48.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:48.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:48.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:49.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:49.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:49.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:49.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:50.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:50.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:50.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:50.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:51.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:51.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:51.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:51.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:52.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:52.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:52.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:52.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:53.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:53.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:53.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:53.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:54.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:54.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:54.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:54.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:32:55.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:55.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:55.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:55.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:56.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:56.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:56.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:56.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:57.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:57.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:57.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:57.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:58.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:58.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:58.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:58.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:59.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:32:59.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:32:59.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:32:59.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:00.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:00.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:00.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:00.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:01.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:01.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:01.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:01.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:02.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:02.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:02.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:02.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:03.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:03.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:03.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:03.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:04.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:04.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:04.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:04.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:05.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:05.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:05.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:05.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:06.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:06.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:06.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:06.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:07.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:07.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:07.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:07.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:08.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:08.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:08.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:08.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:09.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:09.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:09.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:09.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:10.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:10.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:10.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:10.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:11.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:11.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:12.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:12.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:12.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:12.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:13.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:13.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:13.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:13.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:14.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:14.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:14.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:14.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:14.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:14.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:15.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:15.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:16.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:16.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:16.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:16.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:17.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:17.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:17.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:17.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:18.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:18.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:18.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:18.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:19.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:19.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:19.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:19.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:20.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:20.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:20.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:20.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:21.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:21.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:21.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:21.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:22.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:22.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:22.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:22.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:23.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:23.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:23.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:23.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:24.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:24.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:24.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:24.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:25.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:25.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:25.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:25.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:25.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:25.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:26.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:26.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:27.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:26.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:27.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:27.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:28.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:28.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:28.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:28.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:29.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:29.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:29.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:29.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:30.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:30.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:30.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:30.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:31.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:31.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:31.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:31.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:32.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:32.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:32.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:32.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:33.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:33.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:33.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:33.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:34.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:34.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:34.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:34.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:35.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:35.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:35.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:35.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:36.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:36.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:36.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:36.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:37.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:37.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:37.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:37.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:38.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:38.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:38.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:38.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:39.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:39.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:39.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:39.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:40.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:40.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:40.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:40.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:41.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:41.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:41.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:41.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:42.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:42.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:42.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:42.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:43.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:43.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:43.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:43.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:44.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:44.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:44.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:44.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:45.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:45.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:45.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:45.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:46.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:46.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:46.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:46.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:47.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:47.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:47.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:47.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:47.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:47.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:48.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:48.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:49.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:49.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:49.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:49.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:50.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:50.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:50.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:50.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:51.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:51.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:51.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:51.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:52.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:52.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:52.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:52.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:52.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:52.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:53.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:53.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:54.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:54.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:54.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:54.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:55.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:55.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:55.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:55.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:56.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:56.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:56.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:56.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:57.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:57.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:57.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:57.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:58.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:58.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:58.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:58.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:58.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:58.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:59.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:33:59.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:33:59.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:33:59.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:00.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:00.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:01.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:01.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:01.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:01.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:02.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:02.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:02.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:02.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:03.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:03.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:03.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:03.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:04.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:04.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:04.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:04.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:05.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:05.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:05.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:05.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:06.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:06.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:06.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:06.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:07.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:07.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:07.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:07.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:08.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:08.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:08.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:08.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:09.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:09.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:09.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:09.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:10.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:10.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:10.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:10.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:11.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:11.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:11.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:11.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:12.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:12.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:12.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:12.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:13.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:13.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:13.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:13.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:14.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:14.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:14.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:14.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:15.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:15.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:15.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:15.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:16.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:16.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:16.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:16.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:17.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:17.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:17.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:17.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:18.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:18.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:18.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:18.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:19.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:19.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:19.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:19.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:20.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:20.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:20.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:20.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:21.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:21.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:21.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:21.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:22.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:22.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:22.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:22.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:23.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:23.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:23.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:23.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:24.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:24.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:24.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:24.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:25.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:25.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:25.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:25.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:26.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:26.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:26.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:26.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:27.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:27.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:27.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:27.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:28.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:28.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:28.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:28.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:28.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:28.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:29.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:29.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:29.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:29.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:30.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:30.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:30.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:30.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:31.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:31.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:31.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:31.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:32.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:32.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:33.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:33.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:33.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:33.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:33.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:33.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:34.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:34.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:35.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:35.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:35.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:35.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:36.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:36.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:36.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:36.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:37.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:37.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:37.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:37.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:38.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:38.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:38.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:38.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:39.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:39.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:39.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:39.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:40.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:40.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:40.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:40.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:40.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:40.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:41.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:41.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:41.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:41.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:42.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:42.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:42.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:42.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:43.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:43.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:43.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:43.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:44.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:44.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:45.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:45.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:45.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:45.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:46.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:46.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:46.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:46.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:47.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:47.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:47.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:47.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:48.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:48.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:48.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:48.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:49.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:49.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:49.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:49.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:50.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:50.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:50.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:50.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:51.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:51.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:51.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:51.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:52.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:52.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:52.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:52.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:53.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:53.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:53.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:53.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:53.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:53.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:54.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:54.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:54.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:54.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:55.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:55.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:55.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:55.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:56.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:56.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:56.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:56.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:57.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:57.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:57.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:57.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:58.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:58.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:58.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:34:58.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:34:59.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:34:59.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:00.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:00.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:00.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:00.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:00.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:00.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:01.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:01.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:01.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:01.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:02.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:02.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:02.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:02.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:03.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:03.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:03.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:03.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:04.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:04.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:04.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:04.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:05.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:05.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:05.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:05.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:06.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:06.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:06.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:06.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:07.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:07.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:07.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:07.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:08.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:08.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:08.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:08.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:09.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:09.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:09.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:09.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:10.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:10.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:10.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:10.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:11.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:11.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:11.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:11.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:12.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:12.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:12.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:12.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:13.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:13.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:13.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:13.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:14.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:14.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:14.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:14.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:15.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:15.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:15.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:15.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:16.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:16.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:16.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:16.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:17.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:17.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:17.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:17.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:18.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:18.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:18.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:18.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:19.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:19.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:19.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:19.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:20.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:20.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:20.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:20.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:21.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:21.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:21.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:21.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:22.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:22.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:22.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:22.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:23.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:23.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:23.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:23.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:24.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:24.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:24.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:24.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:25.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:25.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:25.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:25.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:26.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:26.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:26.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:26.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:27.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:27.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:27.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:27.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:28.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:28.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:28.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:28.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:29.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:29.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:29.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:29.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:30.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:30.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:30.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:30.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:31.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:31.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:31.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:31.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:32.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:32.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:32.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:32.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:33.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:33.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:33.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:33.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:34.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:34.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:34.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:34.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:35.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:35.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:35.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:35.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:36.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:36.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:36.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:36.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:37.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:37.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:37.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:37.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:38.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:38.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:38.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:38.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:39.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:39.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:39.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:39.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:40.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:40.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:40.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:40.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:41.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:41.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:41.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:41.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:42.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:42.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:42.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:42.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:43.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:43.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:43.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:43.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:44.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:44.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:44.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:44.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:45.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:45.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:45.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:45.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:46.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:46.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:46.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:46.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:47.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:47.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:47.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:47.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:48.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:48.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:48.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:48.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:49.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:49.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:49.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:49.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:50.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:50.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:50.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:50.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:51.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:51.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:51.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:51.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:52.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:52.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:52.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:52.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:53.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:53.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:53.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:53.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:54.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:54.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:54.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:54.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:55.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:55.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:55.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:55.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:56.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:56.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:56.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:56.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:57.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:57.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:57.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:57.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:58.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:58.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:58.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:58.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:59.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:35:59.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:35:59.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:35:59.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:00.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:00.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:00.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:00.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:01.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:01.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:01.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:01.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:02.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:02.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:02.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:02.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:03.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:03.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:03.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:03.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:04.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:04.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:04.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:04.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:05.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:05.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:05.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:05.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:06.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:06.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:07.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:07.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:07.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:07.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:07.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:07.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:08.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:08.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:08.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:08.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:09.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:09.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:09.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:09.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:10.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:10.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:11.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:11.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:11.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:11.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:12.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:11.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:12.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:12.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:13.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:13.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:13.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:13.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:13.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:13.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:14.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:14.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:14.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:14.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:15.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:15.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:16.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:16.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:16.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:16.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:16.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:16.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:17.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:17.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:17.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:17.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:18.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:18.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:18.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:18.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:19.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:19.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:19.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:19.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:20.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:20.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:20.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:20.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:21.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:21.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:21.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:21.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:22.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:22.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:22.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:22.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:23.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:23.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:23.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:23.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:24.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:24.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:24.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:24.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:25.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:25.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:25.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:25.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:26.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:26.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:27.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:26.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:27.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:27.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:28.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:28.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:28.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:28.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:29.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:29.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:29.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:29.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:30.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:30.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:30.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:30.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:31.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:31.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:31.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:31.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:32.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:32.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:32.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:32.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:33.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:33.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:33.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:33.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:34.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:34.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:34.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:34.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:35.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:35.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:35.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:35.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:36.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:36.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:36.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:36.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:37.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:37.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:37.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:37.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:38.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:38.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:38.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:38.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:39.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:39.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:39.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:39.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:40.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:40.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:40.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:40.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:41.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:41.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:41.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:41.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:42.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:42.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:42.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:42.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:43.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:43.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:43.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:43.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:44.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:44.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:44.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:44.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:45.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:45.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:45.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:45.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:46.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:46.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:46.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:46.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:47.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:47.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:47.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:47.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:48.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:48.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:48.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:48.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:49.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:49.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:49.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:49.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:50.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:50.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:50.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:50.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:51.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:51.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:51.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:51.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:52.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:52.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:52.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:52.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:53.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:53.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:53.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:53.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:54.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:54.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:54.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:54.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:55.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:55.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:55.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:55.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:56.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:56.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:56.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:56.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:57.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:57.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:57.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:57.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:58.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:58.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:58.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:58.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:59.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:36:59.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:36:59.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:36:59.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:00.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:00.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:00.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:00.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:01.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:01.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:01.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:01.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:02.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:02.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:02.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:02.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:03.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:03.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:03.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:03.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:04.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:04.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:04.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:04.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:05.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:05.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:05.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:05.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:06.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:06.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:06.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:06.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:07.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:07.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:07.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:07.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:08.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:08.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:08.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:08.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:09.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:09.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:09.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:09.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:10.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:10.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:10.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:10.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:11.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:11.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:11.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:11.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:12.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:12.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:12.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:12.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:13.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:13.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:13.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:13.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:14.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:14.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:14.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:14.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:15.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:15.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:15.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:15.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:16.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:16.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:16.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:16.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:17.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:17.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:17.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:17.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:18.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:18.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:18.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:18.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:19.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:19.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:19.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:19.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:20.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:20.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:20.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:20.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:21.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:21.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:21.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:21.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:22.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:22.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:22.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:22.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:23.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:23.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:23.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:23.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:24.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:24.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:24.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:24.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:25.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:25.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:25.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:25.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:26.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:26.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:26.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:26.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:27.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:27.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:27.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:27.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:28.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:28.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:28.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:28.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:29.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:29.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:29.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:29.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:30.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:30.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:30.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:30.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:31.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:31.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:31.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:31.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:32.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:32.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:32.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:32.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:33.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:33.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:33.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:33.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:34.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:34.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:34.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:34.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:35.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:35.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:35.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:35.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:36.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:36.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:36.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:36.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:37.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:37.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:37.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:37.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:38.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:38.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:38.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:38.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:39.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:39.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:39.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:39.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:40.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:40.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:40.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:40.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:41.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:41.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:41.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:41.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:42.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:42.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:42.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:42.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:43.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:43.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:43.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:43.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:44.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:44.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:44.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:44.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:45.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:45.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:45.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:45.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:46.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:46.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:46.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:46.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:47.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:47.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:47.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:47.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:48.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:48.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:48.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:48.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:49.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:49.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:49.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:49.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:50.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:50.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:50.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:50.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:51.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:51.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:51.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:51.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:52.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:52.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:52.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:52.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:53.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:53.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:53.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:53.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:54.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:54.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:54.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:54.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:55.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:55.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:55.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:55.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:56.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:56.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:56.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:56.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:57.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:57.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:57.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:57.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:58.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:58.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:58.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:58.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:59.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:37:59.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:37:59.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:37:59.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:00.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:00.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:00.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:00.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:01.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:01.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:01.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:01.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:02.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:02.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:02.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:02.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:03.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:03.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:03.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:03.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:04.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:04.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:04.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:04.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:05.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:05.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:05.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:05.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:06.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:06.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:06.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:06.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:07.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:07.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:07.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:07.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:08.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:08.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:08.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:08.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:09.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:09.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:09.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:09.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:10.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:10.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:10.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:10.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:11.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:11.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:11.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:11.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:12.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:12.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:12.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:12.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:13.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:13.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:13.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:13.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:14.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:14.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:14.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:14.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:15.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:15.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:15.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:15.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:16.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:16.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:16.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:16.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:17.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:17.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:17.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:17.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:18.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:18.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:18.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:18.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:19.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:19.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:19.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:19.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:20.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:20.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:20.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:20.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:21.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:21.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:21.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:21.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:22.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:22.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:22.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:22.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:23.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:23.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:23.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:23.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:24.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:24.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:24.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:24.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:25.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:25.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:25.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:25.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:26.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:26.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:26.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:26.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:27.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:27.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:27.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:27.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:28.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:28.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:28.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:28.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:29.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:29.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:29.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:29.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:30.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:30.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:30.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:30.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:31.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:31.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:31.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:31.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:32.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:32.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:32.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:32.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:33.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:33.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:33.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:33.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:34.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:34.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:34.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:34.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:35.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:35.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:35.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:35.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:36.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:36.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:36.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:36.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:37.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:37.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:37.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:37.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:38.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:38.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:38.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:38.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:39.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:39.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:39.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:39.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:40.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:40.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:40.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:40.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:41.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:41.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:41.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:41.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:42.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:42.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:42.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:42.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:43.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:43.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:43.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:43.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:44.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:44.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:44.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:44.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:45.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:45.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:45.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:45.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:46.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:46.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:46.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:46.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:47.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:47.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:47.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:47.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:48.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:48.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:48.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:48.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:49.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:49.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:49.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:49.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:50.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:50.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:50.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:50.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:51.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:51.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:51.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:51.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:52.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:52.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:52.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:52.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:52.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:52.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:53.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:53.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:53.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:53.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:54.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:54.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:54.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:54.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:55.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:55.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:55.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:55.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:56.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:56.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:56.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:56.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:57.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:57.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:57.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:57.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:58.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:58.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:58.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:58.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:59.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:38:59.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:38:59.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:38:59.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:00.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:00.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:00.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:00.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:01.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:01.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:01.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:01.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:02.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:02.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:02.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:02.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:03.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:03.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:03.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:03.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:04.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:04.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:04.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:04.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:05.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:05.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:05.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:05.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:06.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:06.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:06.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:06.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:07.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:07.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:07.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:07.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:08.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:08.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:08.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:08.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:09.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:09.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:09.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:09.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:10.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:10.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:10.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:10.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:11.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:11.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:11.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:11.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:12.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:12.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:12.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:12.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:13.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:13.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:13.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:13.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:14.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:14.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:14.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:14.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:15.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:15.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:15.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:15.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:16.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:16.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:16.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:16.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:17.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:17.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:17.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:17.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:18.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:18.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:18.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:18.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:19.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:19.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:19.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:19.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:20.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:20.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:20.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:20.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:21.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:21.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:21.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:21.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:22.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:22.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:22.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:22.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:23.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:23.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:23.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:23.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:24.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:24.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:24.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:24.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:25.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:25.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:25.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:25.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:26.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:26.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:26.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:26.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:27.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:27.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:27.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:27.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:28.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:28.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:28.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:28.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:29.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:29.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:29.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:29.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:30.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:30.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:30.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:30.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:31.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:31.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:31.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:31.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:32.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:32.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:32.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:32.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:33.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:33.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:33.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:33.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:34.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:34.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:34.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:34.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:35.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:35.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:35.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:35.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:36.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:36.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:36.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:36.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:37.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:37.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:37.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:37.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:38.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:38.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:38.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:38.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:39.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:39.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:39.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:39.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:40.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:40.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:40.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:40.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:41.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:41.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:41.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:41.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:42.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:42.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:42.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:42.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:43.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:43.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:43.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:43.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:44.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:44.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:44.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:44.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:45.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:45.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:45.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:45.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:46.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:46.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:46.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:46.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:47.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:47.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:47.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:47.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:48.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:48.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:48.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:48.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:49.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:49.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:49.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:49.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:50.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:50.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:50.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:50.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:51.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:51.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:51.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:51.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:52.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:52.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:52.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:52.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:53.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:53.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:53.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:53.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:54.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:54.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:54.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:54.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:55.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:55.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:55.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:55.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:56.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:56.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:56.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:56.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:57.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:57.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:57.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:57.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:58.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:58.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:58.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:58.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:59.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:39:59.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:39:59.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:39:59.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:00.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:00.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:00.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:00.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:01.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:01.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:01.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:01.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:02.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:02.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:02.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:02.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:03.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:03.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:03.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:03.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:04.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:04.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:04.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:04.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:05.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:05.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:05.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:05.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:06.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:06.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:06.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:06.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:07.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:07.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:07.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:07.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:08.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:08.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:08.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:08.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:09.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:09.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:09.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:09.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:10.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:10.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:10.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:10.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:11.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:11.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:11.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:11.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:12.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:12.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:12.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:12.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:13.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:13.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:13.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:13.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:14.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:14.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:14.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:14.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:15.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:15.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:15.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:15.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:16.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:16.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:16.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:16.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:17.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:17.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:17.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:17.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:18.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:18.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:18.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:18.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:19.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:19.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:19.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:19.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:20.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:20.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:20.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:20.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:21.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:21.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:21.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:21.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:22.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:22.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:22.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:22.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:23.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:23.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:23.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:23.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:24.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:24.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:24.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:24.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:25.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:25.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:25.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:25.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:26.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:26.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:26.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:26.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:27.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:27.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:27.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:27.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:28.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:28.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:28.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:28.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:29.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:29.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:29.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:29.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:30.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:30.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:30.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:30.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:31.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:31.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:31.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:31.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:32.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:32.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:32.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:32.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:33.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:33.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:33.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:33.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:34.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:34.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:34.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:34.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:35.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:35.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:35.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:35.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:36.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:36.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:36.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:36.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:37.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:37.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:37.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:37.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:38.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:38.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:38.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:38.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:39.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:39.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:39.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:39.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:40.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:40.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:40.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:40.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:41.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:41.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:41.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:41.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:42.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:42.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:42.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:42.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:43.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:43.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:43.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:43.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:44.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:44.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:44.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:44.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:45.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:45.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:45.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:45.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:46.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:46.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:46.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:46.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:47.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:47.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:47.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:47.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:48.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:48.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:48.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:48.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:49.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:49.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:49.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:49.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:50.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:50.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:50.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:50.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:51.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:51.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:51.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:51.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:52.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:52.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:52.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:52.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:53.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:53.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:53.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:53.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:54.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:54.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:54.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:54.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:55.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:55.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:55.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:55.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:56.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:56.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:56.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:56.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:57.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:57.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:57.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:57.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:58.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:58.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:58.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:58.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:59.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:40:59.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:40:59.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:40:59.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:00.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:00.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:00.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:00.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:01.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:01.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:01.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:01.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:02.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:02.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:02.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:02.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:03.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:03.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:03.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:03.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:04.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:04.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:04.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:04.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:05.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:05.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:05.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:05.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:06.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:06.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:06.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:06.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:07.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:07.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:07.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:07.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:08.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:08.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:08.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:08.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:09.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:09.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:09.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:09.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:10.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:10.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:10.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:10.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:11.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:11.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:11.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:11.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:12.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:12.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:12.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:12.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:13.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:13.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:13.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:13.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:14.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:14.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:14.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:14.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:15.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:15.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:15.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:15.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:16.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:16.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:16.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:16.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:17.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:17.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:17.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:17.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:18.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:18.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:18.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:18.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:19.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:19.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:19.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:19.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:20.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:20.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:20.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:20.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:21.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:21.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:21.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:21.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:22.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:22.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:22.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:22.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:23.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:23.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:23.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:23.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:24.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:24.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:24.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:24.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:25.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:25.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:25.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:25.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:26.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:26.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:26.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:26.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:27.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:27.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:28.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:28.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:28.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:28.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:29.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:29.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:29.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:29.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:30.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:29.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:30.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:30.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:31.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:31.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:31.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:31.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:32.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:32.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:32.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:32.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:33.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:33.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:33.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:33.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:34.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:34.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:34.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:34.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:35.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:34.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:35.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:35.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:35.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:35.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:36.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:36.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:36.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:36.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:37.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:37.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:37.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:37.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:38.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:38.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:38.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:38.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:39.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:39.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:39.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:39.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:40.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:40.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:40.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:40.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:41.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:41.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:41.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:41.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:42.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:42.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:42.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:42.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:43.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:43.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:43.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:43.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:44.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:44.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:44.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:44.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:45.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:45.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:45.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:45.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:46.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:46.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:46.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:46.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:47.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:47.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:47.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:47.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:48.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:48.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:48.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:48.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:49.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:49.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:49.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:49.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:50.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:50.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:50.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:50.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:51.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:51.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:51.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:51.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:52.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:52.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:52.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:52.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:53.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:53.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:53.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:53.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:54.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:54.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:54.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:54.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:55.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:55.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:55.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:55.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:56.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:56.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:56.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:56.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:57.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:57.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:57.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:57.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:58.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:58.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:58.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:58.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:59.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:41:59.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:41:59.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:41:59.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:00.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:00.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:00.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:00.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:01.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:01.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:01.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:01.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:02.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:02.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:02.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:02.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:03.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:03.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:03.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:03.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:04.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:04.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:04.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:04.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:05.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:05.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:05.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:05.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:06.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:06.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:06.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:06.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:07.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:07.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:07.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:07.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:08.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:08.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:08.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:08.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:09.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:09.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:09.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:09.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:10.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:10.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:10.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:10.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:11.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:11.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:11.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:11.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:12.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:12.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:12.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:12.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:13.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:13.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:13.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:13.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:14.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:14.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:14.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:14.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:15.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:15.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:15.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:15.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:16.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:16.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:16.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:16.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:17.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:17.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:17.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:17.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:18.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:18.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:18.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:18.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:19.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:19.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:19.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:19.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:20.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:20.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:20.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:20.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:21.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:21.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:21.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:21.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:22.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:22.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:22.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:22.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:23.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:23.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:23.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:23.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:24.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:24.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:24.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:24.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:25.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:25.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:25.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:25.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:26.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:26.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:26.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:26.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:27.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:27.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:27.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:27.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:28.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:28.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:28.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:28.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:29.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:29.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:29.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:29.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:30.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:30.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:30.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:30.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:31.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:31.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:31.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:31.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:32.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:32.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:32.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:32.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:33.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:33.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:33.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:33.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:34.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:34.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:34.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:34.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:35.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:35.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:35.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:35.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:36.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:36.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:37.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:37.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:37.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:37.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:38.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:38.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:38.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:38.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:39.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:39.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:39.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:39.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:40.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:40.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:40.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:40.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:41.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:41.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:41.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:41.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:42.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:42.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:42.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:42.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:43.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:43.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:43.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:43.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:43.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:43.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:44.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:44.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:45.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:45.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:45.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:45.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:46.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:46.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:46.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:46.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:47.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:47.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:47.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:47.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:48.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:48.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:48.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:48.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:49.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:49.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:49.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:49.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:50.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:50.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:50.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:50.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:51.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:51.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:51.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:51.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:52.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:52.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:52.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:52.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:53.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:53.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:53.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:53.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:54.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:54.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:54.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:54.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:55.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:55.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:55.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:55.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:56.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:56.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:56.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:56.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:57.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:57.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:57.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:57.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:58.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:58.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:58.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:58.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:58.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:58.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:59.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:42:59.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:42:59.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:42:59.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:00.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:00.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:01.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:01.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:01.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:01.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:02.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:02.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:02.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:02.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:03.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:03.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:03.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:03.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:03.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:03.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:04.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:04.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:04.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:04.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:05.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:05.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:06.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:06.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:06.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:06.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:07.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:07.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:07.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:07.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:08.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:08.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:08.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:08.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:08.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:08.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:09.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:09.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:09.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:09.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:10.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:10.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:10.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:10.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:11.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:11.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:11.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:11.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:12.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:12.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:12.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:12.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:13.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:13.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:14.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:14.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:14.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:14.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:14.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:14.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:15.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:15.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:16.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:16.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:16.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:16.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:17.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:17.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:17.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:17.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:18.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:18.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:18.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:18.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:19.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:19.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:19.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:19.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:20.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:20.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:20.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:20.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:21.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:21.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:21.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:21.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:22.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:22.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:22.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:22.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:23.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:23.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:23.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:23.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:24.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:24.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:24.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:24.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:25.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:25.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:25.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:25.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:26.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:26.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:26.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:26.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:27.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:27.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:27.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:27.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:28.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:28.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:28.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:28.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:29.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:29.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:29.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:29.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:30.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:30.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:30.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:30.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:31.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:31.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:31.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:31.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:32.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:32.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:32.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:32.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:33.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:33.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:33.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:33.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:34.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:34.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:34.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:34.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:35.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:35.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:35.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:35.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:36.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:36.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:36.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:36.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:37.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:37.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:37.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:37.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:38.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:38.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:38.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:38.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:38.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:38.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:39.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:39.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:39.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:39.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:40.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:40.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:40.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:40.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:41.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:41.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:42.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:42.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:42.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:42.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:42.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:42.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:43.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:43.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:43.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:43.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:44.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:44.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:45.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:44.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:45.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:45.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:46.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:46.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:46.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:46.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:47.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:47.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:47.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:47.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:48.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:48.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:48.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:48.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:49.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:49.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:49.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:49.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:50.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:50.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:50.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:50.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:51.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:51.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:51.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:51.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:52.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:52.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:52.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:52.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:53.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:53.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:53.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:53.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:54.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:54.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:54.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:54.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:55.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:55.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:55.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:55.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:56.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:56.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:56.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:56.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:57.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:57.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:57.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:57.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:58.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:58.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:58.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:58.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:59.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:43:59.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:43:59.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:43:59.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:00.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:00.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:00.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:00.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:01.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:01.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:01.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:01.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:02.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:02.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:02.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:02.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:03.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:03.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:03.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:03.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:04.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:04.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:04.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:04.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:05.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:05.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:05.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:05.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:06.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:06.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:06.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:06.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:07.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:07.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:07.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:07.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:08.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:08.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:08.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:08.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:09.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:09.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:09.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:09.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:10.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:10.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:10.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:10.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:11.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:11.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:11.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:11.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:12.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:12.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:12.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:12.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:13.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:13.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:13.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:13.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:14.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:14.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:14.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:14.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:15.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:15.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:15.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:15.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:16.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:16.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:16.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:16.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:17.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:17.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:17.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:17.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:18.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:18.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:18.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:18.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:19.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:19.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:19.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:19.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:20.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:20.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:20.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:20.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:21.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:21.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:21.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:21.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:22.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:22.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:22.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:22.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:23.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:23.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:23.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:23.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:24.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:24.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:24.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:24.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:25.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:25.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:25.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:25.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:26.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:26.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:26.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:26.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:27.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:27.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:27.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:27.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:28.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:28.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:28.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:28.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:29.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:29.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:29.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:29.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:30.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:30.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:30.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:30.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:31.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:31.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:31.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:31.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:32.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:32.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:32.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:32.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:33.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:33.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:33.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:33.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:34.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:34.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:34.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:34.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:35.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:35.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:35.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:35.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:36.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:36.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:36.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:36.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:37.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:37.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:37.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:37.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:38.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:38.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:38.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:38.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:39.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:39.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:39.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:39.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:40.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:40.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:40.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:40.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:41.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:41.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:41.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:41.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:42.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:42.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:42.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:42.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:43.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:43.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:43.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:43.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:44.097 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T20:44:44.093+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x55ddecea29e0 msgr2=0x7f81ac040890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T20:44:44.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:44.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:44.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:44.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:45.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:45.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:45.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:45.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:46.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:46.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:46.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:46.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:47.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:47.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:47.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:47.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:48.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:48.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:48.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:48.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:49.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:49.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:49.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:49.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:50.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:50.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:50.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:50.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:51.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:51.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:51.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:51.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:52.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:52.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:52.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:52.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:53.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:53.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:53.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:53.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:54.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:54.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:54.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:54.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:55.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:55.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:55.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:55.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:56.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:56.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:56.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:56.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:57.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:57.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:57.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:57.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:58.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:58.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:58.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:58.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:59.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:44:59.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:44:59.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:44:59.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:00.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:00.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:00.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:00.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:01.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:01.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:01.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:01.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:02.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:02.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:02.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:02.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:03.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:03.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:03.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:03.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:04.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:04.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:04.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:04.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:05.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:05.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:05.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:05.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:06.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:06.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:06.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:06.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:07.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:07.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:07.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:07.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:08.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:08.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:08.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:08.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:09.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:09.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:09.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:09.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:10.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:10.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:10.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:10.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:11.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:11.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:11.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:11.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:12.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:12.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:12.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:12.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:13.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:13.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:13.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:13.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:14.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:14.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:14.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:14.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:15.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:15.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:15.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:15.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:16.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:16.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:16.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:16.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:17.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:17.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:17.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:17.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:18.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:18.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:18.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:18.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:19.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:19.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:19.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:19.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:20.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:20.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:20.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:20.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:21.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:21.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:21.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:21.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:22.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:22.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:22.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:22.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:23.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:23.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:23.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:23.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:24.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:24.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:24.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:24.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:25.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:25.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:25.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:25.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:26.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:26.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:26.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:26.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:27.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:27.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:27.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:27.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:28.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:28.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:28.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:28.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:29.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:29.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:29.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:29.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:30.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:30.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:30.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:30.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:31.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:31.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:31.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:31.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:32.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:32.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:32.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:32.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:33.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:33.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:33.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:33.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:34.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:34.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:34.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:34.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:35.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:35.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:35.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:35.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:36.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:36.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:36.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:36.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:37.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:37.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:37.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:37.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:38.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:38.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:38.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:38.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:39.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:39.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:39.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:39.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:40.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:40.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:40.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:40.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:41.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:41.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:41.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:41.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:42.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:42.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:42.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:42.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:43.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:43.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:43.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:43.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:44.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:44.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:44.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:44.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:45.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:45.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:45.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:45.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:46.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:46.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:46.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:46.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:47.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:47.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:47.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:47.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:48.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:48.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:48.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:48.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:49.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:49.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:49.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:49.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:50.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:50.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:50.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:50.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:51.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:51.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:51.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:51.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:52.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:52.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:52.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:52.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:53.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:53.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:53.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:53.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:54.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:54.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:54.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:54.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:55.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:55.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:55.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:55.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:56.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:56.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:56.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:56.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:57.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:57.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:57.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:57.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:58.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:58.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:58.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:58.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:59.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:45:59.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:45:59.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:45:59.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:00.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:00.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:00.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:00.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:01.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:01.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:01.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:01.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:02.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:02.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:02.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:02.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:03.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:03.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:03.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:03.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:04.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:04.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:04.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:04.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:05.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:05.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:05.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:05.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:06.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:06.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:06.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:06.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:07.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:07.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:07.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:07.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:08.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:08.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:08.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:08.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:09.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:09.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:09.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:09.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:10.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:10.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:10.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:10.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:11.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:11.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:11.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:11.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:12.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:12.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:12.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:12.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:13.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:13.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:13.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:13.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:14.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:14.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:14.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:14.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:15.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:15.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:15.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:15.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:16.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:16.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:16.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:16.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:17.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:17.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:17.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:17.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:18.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:18.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:18.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:18.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:19.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:19.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:19.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:19.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:20.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:20.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:20.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:20.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:21.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:21.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:21.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:21.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:22.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:22.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:22.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:22.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:23.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:23.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:23.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:23.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:24.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:24.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:24.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:24.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:25.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:25.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:25.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:25.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:26.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:26.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:26.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:26.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:27.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:27.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:27.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:27.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:28.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:28.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:28.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:28.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:29.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:29.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:29.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:29.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:30.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:30.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:30.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:30.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:31.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:31.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:31.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:31.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:32.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:32.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:32.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:32.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:33.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:33.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:33.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:33.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:34.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:34.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:34.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:34.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:35.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:35.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:35.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:35.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:36.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:36.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:36.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:36.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:37.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:37.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:37.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:37.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:38.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:38.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:38.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:38.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:39.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:39.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:39.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:39.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:40.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:40.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:40.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:40.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:41.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:41.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:41.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:41.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:42.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:42.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:42.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:42.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:43.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:43.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:43.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:43.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:44.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:44.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:44.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:44.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:45.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:45.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:45.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:45.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:46.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:46.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:46.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:46.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:47.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:47.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:47.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:47.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:48.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:48.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:48.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:48.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:49.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:49.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:49.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:49.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:50.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:50.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:50.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:50.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:51.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:51.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:51.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:51.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:52.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:52.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:52.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:52.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:53.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:53.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:53.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:53.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:54.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:54.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:54.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:54.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:55.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:55.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:55.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:55.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:56.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:56.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:56.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:56.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:57.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:57.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:57.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:57.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:58.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:58.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:58.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:58.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:59.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:46:59.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:46:59.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:46:59.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:00.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:00.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:00.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:00.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:01.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:01.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:01.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:01.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:02.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:02.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:02.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:02.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:03.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:03.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:03.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:03.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:04.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:04.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:04.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:04.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:05.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:05.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:05.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:05.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:06.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:06.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:06.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:06.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:07.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:07.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:07.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:07.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:08.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:08.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:08.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:08.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:09.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:09.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:09.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:09.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:10.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:10.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:10.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:10.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:11.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:11.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:11.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:11.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:12.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:12.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:12.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:12.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:13.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:13.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:13.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:13.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:14.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:14.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:14.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:14.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:15.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:15.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:15.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:15.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:16.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:16.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:16.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:16.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:17.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:17.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:17.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:17.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:18.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:18.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:18.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:18.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:19.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:19.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:19.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:19.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:20.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:20.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:20.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:20.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:21.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:21.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:21.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:21.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:22.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:22.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:22.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:22.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:23.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:23.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:23.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:23.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:24.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:24.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:24.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:24.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 69 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:25.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:25.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:25.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:25.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:26.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:26.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:26.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:26.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:27.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:27.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:27.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:27.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:28.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:28.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:28.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:28.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:29.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:29.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:29.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:29.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:30.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:30.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:30.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:30.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:31.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:31.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:31.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:31.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:32.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:32.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:32.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:32.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:33.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:33.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:33.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:33.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:34.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:34.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:34.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:34.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:35.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:35.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:35.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:35.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:36.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:36.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:36.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:36.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:37.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:37.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:37.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:37.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:38.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:38.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:38.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:38.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:39.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:39.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:39.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:39.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:40.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:40.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:40.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:40.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:41.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:41.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:41.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:41.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:42.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:42.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:42.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:42.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:43.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:43.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:43.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:43.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:44.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:44.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:44.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:44.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:45.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:45.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:45.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:45.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:46.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:46.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:46.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:46.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:47.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:47.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:47.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:47.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:48.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:48.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:48.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:48.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:49.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:49.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:49.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:49.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:50.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:50.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:50.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:50.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:51.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:51.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:51.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:51.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:52.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:52.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:52.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:52.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:53.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:53.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:53.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:53.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:54.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:54.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:54.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:54.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 4 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T20:47:55.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:55.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:55.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:55.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:56.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:56.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:56.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:56.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:57.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:57.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:57.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:57.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:58.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:58.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:58.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:58.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:59.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:47:59.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:47:59.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:47:59.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:00.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:00.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:00.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:00.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:01.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:01.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:01.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:01.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:02.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:02.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:02.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:02.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:03.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:03.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:03.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:03.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:04.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:04.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:04.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:04.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:05.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:05.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:05.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:05.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:06.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:06.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:06.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:06.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:07.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:07.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:07.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:07.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:08.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:08.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:08.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:08.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:09.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:09.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:09.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:09.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:10.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:10.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:10.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:10.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:11.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:11.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:11.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:11.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:12.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:12.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:12.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:12.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:13.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:13.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:13.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:13.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:14.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:14.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:14.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:14.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:15.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:15.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:15.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:15.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:16.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:16.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:16.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:16.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:17.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:17.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:17.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:17.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:18.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:18.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:18.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:18.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:19.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:19.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:19.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:19.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:20.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:20.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:20.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:20.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:21.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:21.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:21.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:21.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:22.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:22.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:22.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:22.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:23.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:23.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:23.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:23.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:24.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:24.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:24.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:24.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:25.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:25.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:25.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:25.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:26.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:26.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:26.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:26.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:27.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:27.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:27.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:27.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:28.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:28.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:28.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:28.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:29.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:29.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:29.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:29.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:30.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:30.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:30.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:30.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:31.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:31.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:31.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:31.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:32.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:32.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:32.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:32.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:33.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:33.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:33.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:33.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:34.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:34.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:34.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:34.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:35.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:35.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:35.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:35.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:36.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:36.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:36.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:36.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:37.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:37.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:37.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:37.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:38.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:38.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:38.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:38.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:39.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:39.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:39.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:39.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:40.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:40.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:40.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:40.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:41.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:41.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:41.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:41.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:42.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:42.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:42.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:42.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:43.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:43.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:43.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:43.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:44.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:44.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:44.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:44.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:45.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:45.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:45.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:45.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:46.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:46.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:46.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:46.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:47.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:47.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:47.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:47.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:48.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:48.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:48.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:48.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:49.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:49.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:50.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:50.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:50.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:50.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:51.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:51.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:51.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:51.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:52.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:52.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:52.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:52.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:53.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:53.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:53.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:53.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:54.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:54.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:54.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:54.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:55.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:55.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:55.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:55.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:56.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:56.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:56.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:56.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:57.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:57.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:57.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:57.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:58.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:58.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:58.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:58.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:59.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:48:59.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:48:59.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:48:59.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:00.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:00.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:00.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:00.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:01.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:00.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:01.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:01.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:02.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:01.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:02.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:02.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:03.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:03.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:03.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:03.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:04.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:04.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:04.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:04.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:05.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:05.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:05.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:05.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:05.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:05.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:06.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:06.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:07.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:07.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:07.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:07.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:08.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:07.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:08.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:08.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:09.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:09.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:09.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:09.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:09.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:09.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:10.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:10.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:10.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:10.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:11.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:11.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:12.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:12.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:12.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:12.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:13.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:13.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:13.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:13.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:14.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:14.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:14.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:14.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:15.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:15.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:15.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:15.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:16.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:16.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:16.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:16.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:17.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:17.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:17.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:17.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:18.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:18.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:18.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:18.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:19.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:19.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:19.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:19.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:20.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:20.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:20.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:20.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:21.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:21.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:21.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:21.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:22.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:22.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:22.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:22.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:23.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:23.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:23.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:23.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:24.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:24.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:24.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:24.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:25.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:25.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:25.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:25.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:26.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:26.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:26.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:26.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:27.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:27.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:27.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:27.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:28.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:28.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:28.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:28.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:29.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:29.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:29.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:29.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:30.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:30.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:30.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:30.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:31.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:31.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:31.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:31.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:31.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:31.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:32.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:32.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:33.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:33.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:33.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:33.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:33.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:33.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:34.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:34.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:34.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:34.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:35.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:35.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:35.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:35.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:36.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:36.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:36.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:36.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:37.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:37.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:37.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:37.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:38.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:38.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:38.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:38.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:39.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:39.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:39.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:39.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:40.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:40.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:40.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:40.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:41.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:41.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:41.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:41.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:42.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:42.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:42.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:42.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:43.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:43.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:43.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:43.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:44.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:44.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:44.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:44.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:45.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:45.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:45.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:45.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:46.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:46.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:46.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:46.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:47.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:47.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:47.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:47.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:48.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:48.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:48.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:48.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:49.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:49.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:49.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:49.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:50.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:50.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:50.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:50.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:51.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:51.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:51.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:51.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:52.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:52.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:52.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:52.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:53.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:53.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:53.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:53.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:54.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:54.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:54.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:54.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:55.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:55.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:55.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:55.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:56.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:56.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:56.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:56.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:57.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:57.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:57.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:57.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:58.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:58.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:58.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:49:58.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:49:59.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:49:59.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:00.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:00.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:00.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:00.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:01.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:01.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:01.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:01.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:01.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:01.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:02.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:02.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:02.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:02.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:03.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:03.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:03.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:03.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:04.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:04.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:04.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:04.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:05.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:05.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:05.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:05.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:06.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:06.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:06.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:06.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:07.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:07.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:07.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:07.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:08.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:08.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:08.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:08.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:09.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:09.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:09.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:09.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:10.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:10.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:11.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:11.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:11.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:11.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:12.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:12.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:12.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:12.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:12.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:12.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:13.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:13.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:14.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:14.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:14.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:14.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:15.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:14.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:15.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:15.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:15.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:15.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:16.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:16.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:16.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:16.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:17.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:17.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:17.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:17.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:18.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:18.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:19.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:19.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:19.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:19.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:20.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:19.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:20.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:20.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:20.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:20.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:21.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:21.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:21.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:21.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:22.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:22.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:22.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:22.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:23.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:23.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:24.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:24.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:24.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:24.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:25.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:25.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:25.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:25.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:26.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:26.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:26.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:26.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:27.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:27.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:27.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:27.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:28.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:28.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:28.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:28.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:29.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:29.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:29.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:29.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:30.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:30.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:31.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:31.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:31.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:31.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:31.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:31.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:32.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:32.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:33.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:33.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:33.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:33.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:33.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:33.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:34.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:34.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:34.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:34.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:35.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:35.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:35.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:35.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:36.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:36.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:37.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:37.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:37.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:37.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:38.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:38.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:38.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:38.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:39.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:39.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:39.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:39.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:40.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:40.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:40.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:40.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:41.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:41.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:41.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:41.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:42.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:42.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:42.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:42.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:43.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:43.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:43.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:43.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:44.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:44.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:44.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:44.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:44.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:44.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:45.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:45.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:45.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:45.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:46.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:46.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:46.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:46.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:47.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:47.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:47.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:47.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:48.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:48.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:48.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:48.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:49.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:49.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:49.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:49.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:50.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:50.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:50.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:50.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:51.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:51.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:51.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:51.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:52.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:51.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:52.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:52.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:53.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:53.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:53.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:53.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:54.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:54.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:54.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:54.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:55.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:55.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:55.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:55.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:56.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:56.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:56.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:56.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:57.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:57.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:57.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:57.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:57.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:57.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:58.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:58.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:58.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:58.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:59.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:50:59.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:50:59.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:50:59.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:00.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:00.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:00.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:00.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:01.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:01.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:01.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:01.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:02.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:02.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:02.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:02.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:03.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:03.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:03.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:03.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:04.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:04.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:04.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:04.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:05.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:05.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:05.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:05.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:06.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:06.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:06.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:06.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:07.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:07.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:07.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:07.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:08.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:08.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:08.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:08.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:09.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:09.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:09.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:09.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:10.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:10.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:10.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:10.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:11.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:11.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:11.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:11.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:12.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:12.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:12.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:12.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:13.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:13.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:13.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:13.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:14.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:14.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:14.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:14.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:15.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:15.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:15.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:15.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:16.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:16.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:16.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:16.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:17.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:17.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:17.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:17.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:18.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:18.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:18.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:18.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:19.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:19.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:19.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:19.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:20.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:20.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:20.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:20.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:21.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:21.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:21.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:21.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:22.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:22.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:22.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:22.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:23.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:23.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:23.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:23.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:24.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:24.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:24.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:24.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:25.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:25.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:25.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:25.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:26.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:26.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:26.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:26.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:27.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:27.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:27.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:27.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:28.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:28.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:28.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:28.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:29.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:29.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:29.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:29.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:30.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:30.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:30.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:30.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:31.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:31.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:31.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:31.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:32.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:32.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:32.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:32.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:33.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:33.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:33.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:33.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:34.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:34.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:34.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:34.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:35.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:35.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:35.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:35.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:36.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:36.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:36.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:36.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:37.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:37.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:37.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:37.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:38.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:38.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:38.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:38.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:39.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:39.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:39.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:39.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:40.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:40.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:40.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:40.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:41.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:41.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:41.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:41.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:42.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:42.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:42.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:42.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:43.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:43.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:43.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:43.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:44.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:44.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:44.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:44.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:45.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:45.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:45.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:45.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:46.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:46.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:46.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:46.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:47.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:47.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:47.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:47.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:48.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:48.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:48.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:48.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:49.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:49.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:49.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:49.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:50.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:50.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:50.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:50.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:51.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:51.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:51.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:51.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:52.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:52.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:52.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:52.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:53.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:53.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:53.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:53.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:54.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:54.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:54.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:54.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:55.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:55.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:55.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:55.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:56.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:56.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:56.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:56.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:57.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:57.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:57.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:57.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:58.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:58.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:58.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:58.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:59.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:51:59.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:51:59.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:51:59.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:00.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:00.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:00.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:00.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:01.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:01.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:01.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:01.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:02.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:02.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:02.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:02.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:03.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:03.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:03.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:03.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:04.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:04.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:04.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:04.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:05.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:05.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:05.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:05.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:06.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:06.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:06.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:06.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:07.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:07.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:07.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:07.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:08.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:08.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:08.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:08.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:09.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:09.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:09.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:09.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:10.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:10.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:10.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:10.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:11.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:11.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:11.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:11.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:12.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:12.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:12.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:12.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:13.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:13.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:13.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:13.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:14.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:14.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:14.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:14.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:15.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:15.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:15.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:15.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:16.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:16.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:16.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:16.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:17.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:17.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:17.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:17.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:18.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:18.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:18.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:18.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:19.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:19.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:19.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:19.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:20.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:20.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:20.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:20.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:21.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:21.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:21.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:21.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:22.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:22.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:22.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:22.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:23.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:23.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:23.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:23.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:24.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:24.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:24.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:24.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:25.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:25.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:25.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:25.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:26.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:26.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:26.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:26.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:27.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:27.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:27.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:27.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:28.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:28.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:28.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:28.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:29.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:29.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:29.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:29.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:30.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:30.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:30.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:30.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:31.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:31.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:31.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:31.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:32.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:32.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:32.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:32.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:33.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:33.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:33.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:33.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:34.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:34.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:34.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:34.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:35.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:35.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:35.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:35.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:36.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:36.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:36.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:36.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:37.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:37.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:37.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:37.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:38.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:38.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:38.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:38.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:39.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:39.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:39.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:39.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:40.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:40.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:40.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:40.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:41.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:41.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:41.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:41.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:42.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:42.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:42.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:42.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:43.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:43.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:43.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:43.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:44.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:44.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:44.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:44.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:45.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:45.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:45.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:45.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:46.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:46.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:46.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:46.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:47.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:47.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:47.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:47.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:48.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:48.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:48.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:48.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:49.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:49.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:49.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:49.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:50.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:50.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:50.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:50.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:51.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:51.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:51.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:51.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:52.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:52.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:52.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:52.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:53.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:53.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:53.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:53.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:54.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:54.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:54.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:54.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:55.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:55.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:55.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:55.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:56.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:56.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:56.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:56.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:57.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:57.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:57.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:57.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:58.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:58.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:58.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:58.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:59.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:52:59.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:52:59.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:52:59.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:00.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:00.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:00.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:00.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:01.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:01.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:01.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:01.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:02.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:02.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:02.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:02.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:03.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:03.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:03.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:03.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:04.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:04.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:04.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:04.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:05.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:05.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:05.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:05.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:06.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:06.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:06.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:06.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:07.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:07.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:07.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:07.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:08.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:08.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:08.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:08.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:09.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:09.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:09.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:09.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:10.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:10.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:10.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:10.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:11.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:11.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:11.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:11.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:12.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:12.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:12.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:12.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:13.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:13.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:13.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:13.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:14.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:14.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:14.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:14.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:15.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:15.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:15.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:15.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:16.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:16.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:16.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:16.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:17.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:17.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:17.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:17.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:18.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:18.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:18.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:18.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:19.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:19.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:19.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:19.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:20.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:20.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:20.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:20.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:21.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:21.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:21.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:21.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:22.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:22.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:22.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:22.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:23.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:23.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:23.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:23.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:24.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:24.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:24.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:24.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:25.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:25.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:25.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:25.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:26.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:26.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:26.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:26.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:27.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:27.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:27.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:27.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:28.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:28.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:28.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:28.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:29.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:29.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:29.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:29.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:30.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:30.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:30.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:30.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:31.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:31.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:31.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:31.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:32.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:32.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:32.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:32.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:33.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:33.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:33.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:33.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:34.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:34.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:34.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:34.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:35.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:35.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:35.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:35.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:36.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:36.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:36.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:36.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:37.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:37.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:37.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:37.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:38.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:38.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:38.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:38.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:39.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:39.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:39.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:39.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:40.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:40.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:40.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:40.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:41.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:41.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:41.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:41.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:42.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:42.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:42.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:42.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:43.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:43.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:43.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:43.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:44.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:44.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:44.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:44.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:45.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:45.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:45.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:45.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:46.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:46.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:46.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:46.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:47.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:47.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:47.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:47.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:48.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:48.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:48.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:48.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:49.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:49.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:49.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:49.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:50.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:50.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:50.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:50.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:51.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:51.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:51.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:51.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:52.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:52.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:53.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:52.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:53.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:53.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:53.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:53.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:54.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:54.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:54.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:54.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:55.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:55.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:55.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:55.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:56.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:56.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:56.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:56.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:57.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:57.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:57.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:57.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:58.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:58.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:58.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:58.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:53:59.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:53:59.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:00.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:53:59.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:00.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:00.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:00.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:00.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:01.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:01.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:01.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:01.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:02.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:02.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:03.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:02.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:03.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:03.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:04.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:04.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:04.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:04.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:04.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:04.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:05.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:05.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:05.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:05.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:06.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:06.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:06.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:06.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:07.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:07.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:07.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:07.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:08.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:08.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:08.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:08.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:09.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:09.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:09.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:09.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:10.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:10.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:10.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:10.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:11.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:11.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:11.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:11.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:12.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:12.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:12.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:12.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:13.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:13.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:13.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:13.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:14.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:14.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:14.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:14.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:15.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:15.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:15.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:15.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:16.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:16.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:16.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:16.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:17.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:17.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:17.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:17.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:18.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:18.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:18.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:18.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:19.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:19.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:19.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:19.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:20.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:20.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:20.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:20.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:21.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:21.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:21.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:21.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:22.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:22.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:22.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:22.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:23.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:23.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:23.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:23.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:24.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:24.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:24.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:24.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:25.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:25.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:25.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:25.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:26.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:26.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:26.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:26.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:27.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:27.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:27.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:27.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:28.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:28.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:28.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:28.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:29.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:29.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:29.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:29.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:30.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:30.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:30.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:30.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:31.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:31.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:31.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:31.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:32.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:32.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:32.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:32.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:33.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:33.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:33.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:33.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:34.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:34.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:34.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:34.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:35.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:35.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:35.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:35.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:36.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:36.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:36.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:36.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:37.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:37.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:37.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:37.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:38.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:38.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:38.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:38.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:39.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:39.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:39.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:39.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:40.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:40.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:40.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:40.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:41.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:41.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:41.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:41.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:42.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:42.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:42.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:42.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:43.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:43.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:43.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:43.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:44.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:44.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:44.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:44.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:45.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:45.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:45.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:45.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:46.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:46.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:46.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:46.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:47.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:47.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:47.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:47.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:48.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:48.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:48.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:48.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:49.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:49.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:49.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:49.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:50.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:50.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:50.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:50.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:51.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:51.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:51.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:51.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:52.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:52.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:52.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:52.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:53.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:53.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:53.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:53.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:54.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:54.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:54.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:54.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:55.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:55.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:55.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:55.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:56.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:56.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:56.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:56.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:57.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:57.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:57.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:57.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:58.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:58.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:58.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:58.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:59.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:54:59.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:54:59.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:54:59.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:00.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:00.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:00.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:00.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:01.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:01.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:01.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:01.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:02.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:02.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:02.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:02.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:03.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:03.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:03.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:03.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:04.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:04.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:04.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:04.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:05.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:05.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:05.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:05.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:06.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:06.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:07.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:07.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:07.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:07.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:08.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:08.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:08.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:08.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:09.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:09.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:09.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:09.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:10.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:10.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:10.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:10.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:11.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:11.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:11.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:11.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:12.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:12.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:12.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:12.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:13.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:13.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:13.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:13.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:14.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:14.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:14.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:14.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:15.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:15.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:15.435 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T20:55:15.431+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ddecea32f0 msgr2=0x7f81ac0413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T20:55:15.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:15.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:16.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:16.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:16.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:16.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:17.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:17.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:17.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:17.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:18.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:18.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:18.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:18.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:19.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:19.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:19.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:19.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:20.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:20.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:20.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:20.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:21.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:21.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:21.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:21.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:22.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:22.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:22.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:22.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:23.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:23.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:23.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:23.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:24.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:24.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:24.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:24.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:25.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:25.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:25.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:25.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:26.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:26.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:26.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:26.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:27.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:27.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:27.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:27.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:28.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:28.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:28.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:28.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:29.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:29.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:29.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:29.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:30.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:30.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:30.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:30.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:31.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:31.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:31.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:31.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:32.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:32.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:32.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:32.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:33.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:33.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:33.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:33.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:34.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:34.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:34.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:34.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:35.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:35.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:35.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:35.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:36.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:36.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:36.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:36.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:37.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:37.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:37.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:37.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:38.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:38.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:38.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:38.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:39.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:39.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:39.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:39.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:40.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:40.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:40.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:40.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:41.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:41.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:41.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:41.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:42.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:42.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:42.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:42.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:43.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:43.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:43.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:43.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:44.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:44.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:44.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:44.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:45.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:45.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:45.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:45.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:46.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:46.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:46.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:46.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:47.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:47.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:47.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:47.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:48.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:48.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:48.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:48.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:49.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:49.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:49.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:49.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:50.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:50.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:50.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:50.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:51.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:51.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:51.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:51.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:52.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:52.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:52.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:52.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:53.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:53.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:53.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:53.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:54.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:54.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:54.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:54.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:55.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:55.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:55.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:55.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:56.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:56.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:56.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:56.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:57.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:57.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:57.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:57.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:58.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:58.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:58.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:58.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:59.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:55:59.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:55:59.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:55:59.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:00.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:00.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:00.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:00.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:01.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:01.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:01.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:01.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:02.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:02.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:02.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:02.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:03.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:03.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:03.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:03.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:04.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:04.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:04.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:04.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:05.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:05.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:05.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:05.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:06.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:06.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:06.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:06.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:07.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:07.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:07.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:07.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:08.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:08.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:08.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:08.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:09.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:09.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:09.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:09.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:10.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:10.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:10.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:10.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:11.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:11.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:11.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:11.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:12.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:12.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:12.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:12.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:13.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:13.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:13.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:13.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:14.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:14.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:14.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:14.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:15.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:15.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:15.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:15.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:16.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:16.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:16.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:16.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:17.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:17.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:17.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:17.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:18.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:18.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:18.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:18.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:19.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:19.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:19.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:19.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:20.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:20.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:20.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:20.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:21.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:21.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:21.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:21.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:22.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:22.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:22.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:22.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:23.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:23.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:23.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:23.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:24.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:24.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:24.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:24.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:25.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:25.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:25.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:25.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:26.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:26.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:26.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:26.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:27.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:27.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:27.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:27.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:28.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:28.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:28.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:28.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:29.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:29.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:29.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:29.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:30.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:30.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:30.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:30.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:31.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:31.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:31.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:31.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:32.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:32.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:32.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:32.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:33.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:33.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:33.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:33.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:34.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:34.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:34.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:34.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:35.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:35.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:35.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:35.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:36.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:36.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:36.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:36.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:37.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:37.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:37.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:37.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:38.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:38.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:38.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:38.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:39.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:39.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:39.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:39.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:40.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:40.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:40.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:40.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:41.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:41.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:41.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:41.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:42.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:42.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:42.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:42.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:43.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:43.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:43.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:43.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:44.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:44.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:44.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:44.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:45.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:45.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:45.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:45.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:46.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:46.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:46.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:46.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:47.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:47.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:47.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:47.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:48.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:48.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:48.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:48.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:49.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:49.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:49.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:49.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:50.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:50.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:50.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:50.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:51.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:51.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:51.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:51.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:52.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:52.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:52.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:52.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:53.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:53.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:53.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:53.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:54.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:54.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:54.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:54.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:55.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:55.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:55.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:55.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:56.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:56.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:56.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:56.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:57.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:57.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:57.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:57.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:58.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:58.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:58.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:58.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:59.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:56:59.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:56:59.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:56:59.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:00.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:00.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:00.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:00.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:01.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:01.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:01.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:01.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:02.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:02.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:02.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:02.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:03.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:03.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:03.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:03.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:04.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:04.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:04.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:04.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:05.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:05.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:05.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:05.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:06.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:06.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:06.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:06.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:07.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:07.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:07.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:07.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:08.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:08.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:08.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:08.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:09.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:09.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:09.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:09.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:10.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:10.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:10.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:10.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:11.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:11.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:11.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:11.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:12.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:12.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:12.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:12.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:13.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:13.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:13.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:13.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:14.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:14.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:14.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:14.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:15.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:15.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:15.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:15.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:16.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:16.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:16.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:16.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:17.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:17.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:17.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:17.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:18.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:18.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:18.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:18.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:19.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:19.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:19.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:19.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:20.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:20.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:20.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:20.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:21.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:21.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:21.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:21.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:22.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:22.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:22.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:22.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:23.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:23.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:23.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:23.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:24.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:24.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:24.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:24.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:25.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:25.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:25.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:25.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:26.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:26.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:26.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:26.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:27.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:27.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:27.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:27.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:28.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:28.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:28.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:28.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:29.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:29.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:29.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:29.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:30.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:30.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:30.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:30.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:31.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:31.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:31.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:31.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:32.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:32.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:32.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:32.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:33.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:33.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:33.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:33.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:34.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:34.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:34.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:34.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:35.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:35.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:35.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:35.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:36.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:36.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:36.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:36.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:37.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:37.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:37.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:37.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:38.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:38.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:38.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:38.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:39.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:39.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:39.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:39.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:40.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:40.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:40.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:40.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:41.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:41.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:41.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:41.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:42.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:42.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:42.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:42.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:43.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:43.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:43.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:43.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:44.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:44.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:44.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:44.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:45.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:45.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:45.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:45.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:46.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:46.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:46.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:46.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:47.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:47.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:47.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:47.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:48.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:48.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:48.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:48.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:49.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:49.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:49.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:49.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:50.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:50.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:50.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:50.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:51.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:51.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:51.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:51.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:52.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:52.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:52.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:52.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:53.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:53.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:53.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:53.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:54.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:54.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:54.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:54.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:55.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:55.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:55.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:55.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:56.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:56.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:56.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:56.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:57.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:57.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:57.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:57.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:58.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:58.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:58.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:58.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:59.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:57:59.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:57:59.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:57:59.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:00.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:00.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:00.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:00.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:01.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:01.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:01.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:01.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:02.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:02.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:02.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:02.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:03.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:03.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:03.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:03.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:04.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:04.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:04.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:04.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:05.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:05.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:05.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:05.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:06.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:06.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:06.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:06.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:07.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:07.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:07.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:07.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:08.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:08.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:08.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:08.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:09.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:09.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:09.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:09.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:10.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:10.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:10.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:10.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:11.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:11.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:11.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:11.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:12.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:12.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:12.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:12.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:13.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:13.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:13.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:13.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:14.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:14.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:14.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:14.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:15.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:15.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:15.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:15.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:16.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:16.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:16.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:16.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:17.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:17.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:17.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:17.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:18.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:18.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:18.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:18.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:19.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:19.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:19.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:19.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:20.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:20.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:20.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:20.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:21.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:21.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:21.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:21.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:22.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:22.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:22.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:22.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:23.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:23.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:23.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:23.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:24.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:24.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:24.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:24.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:25.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:25.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:25.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:25.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:26.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:26.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:26.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:26.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:27.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:27.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:27.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:27.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:28.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:28.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:28.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:28.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:29.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:29.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:29.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:29.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:30.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:30.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:30.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:30.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:31.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:31.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:32.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:32.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:32.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:32.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:33.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:33.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:33.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:33.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:33.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:33.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:34.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:34.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:35.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:35.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:35.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:35.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:35.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:35.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:36.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:36.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:37.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:37.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:37.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:37.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:38.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:38.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:38.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:38.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:39.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:39.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:39.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:39.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:40.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:40.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:40.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:40.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:41.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:41.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:41.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:41.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:42.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:42.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:42.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:42.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:42.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:42.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:43.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:43.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:43.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:43.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:44.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:44.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:45.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:45.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:45.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:45.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:45.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:45.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:46.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:46.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:46.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:46.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:47.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:47.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:47.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:47.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:48.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:48.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:48.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:48.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:49.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:49.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:49.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:49.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:50.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:50.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:50.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:50.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:51.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:51.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:51.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:51.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:52.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:52.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:52.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:52.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:53.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:53.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:53.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:53.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:54.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:54.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:54.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:54.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:55.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:55.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:55.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:55.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:56.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:56.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:56.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:56.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:57.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:57.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:57.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:57.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:58.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:58.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:58.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:58.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:59.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:58:59.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:58:59.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:58:59.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:00.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:00.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:00.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:00.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:01.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:01.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:01.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:01.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:02.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:02.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:02.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:02.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:03.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:03.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:03.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:03.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:04.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:04.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:04.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:04.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:05.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:05.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:05.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:05.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:06.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:06.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:06.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:06.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:07.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:07.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:07.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:07.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:08.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:08.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:08.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:08.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:09.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:09.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:10.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:10.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:10.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:10.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:10.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:10.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:11.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:11.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:12.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:12.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:12.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:12.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:13.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:13.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:13.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:13.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:14.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:14.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:14.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:14.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:14.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:14.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:15.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:15.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:15.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:15.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:16.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:16.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:16.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:16.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:17.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:17.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:17.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:17.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:18.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:18.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:18.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:18.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:19.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:19.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:19.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:19.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:20.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:20.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:20.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:20.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:21.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:21.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:21.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:21.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:22.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:22.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:22.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:22.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:23.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:23.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:23.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:23.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:24.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:24.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:24.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:24.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:25.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:25.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:25.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:25.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:26.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:26.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:26.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:26.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:27.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:27.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:27.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:27.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:28.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:28.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:29.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:29.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:29.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:29.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:29.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:29.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:30.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:30.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:30.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:30.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:31.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:31.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:31.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:31.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:32.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:32.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:32.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:32.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:33.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:33.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:33.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:33.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:34.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:34.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:34.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:34.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:35.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:35.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:35.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:35.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:36.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:36.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:36.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:36.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:37.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:37.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:37.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:37.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:38.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:38.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:38.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:38.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:39.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:39.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:39.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:39.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:40.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:40.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:40.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:40.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:41.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:41.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:41.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:41.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:42.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:42.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:42.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:42.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:43.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:43.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:43.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:43.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:44.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:44.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:44.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:44.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:45.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:45.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:45.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:45.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:46.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:46.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:46.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:46.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:47.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:47.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:47.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:47.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:48.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:48.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:48.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:48.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:49.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:49.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:49.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:49.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:50.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:50.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:50.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:50.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:51.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:51.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:51.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:51.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:52.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:52.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:52.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:52.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:53.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:53.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:53.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:53.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:54.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:54.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:54.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:54.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:55.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:55.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:55.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:55.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:56.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:56.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:56.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:56.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:57.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:57.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:57.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:57.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:58.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:58.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:58.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:58.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:59.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T20:59:59.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T20:59:59.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T20:59:59.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:00.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:00.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:01.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:01.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:01.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:01.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:01.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:01.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:02.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:02.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:02.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:02.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:03.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:03.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:03.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:03.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:04.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:04.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:04.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:04.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:05.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:05.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:05.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:05.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:06.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:06.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:06.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:06.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:07.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:07.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:07.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:07.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:08.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:08.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:08.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:08.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:09.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:09.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:09.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:09.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:10.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:10.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:10.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:10.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:11.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:11.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:11.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:11.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:12.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:12.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:12.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:12.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:13.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:13.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:13.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:13.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:14.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:14.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:14.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:14.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:15.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:15.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:15.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:15.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:16.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:16.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:16.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:16.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:17.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:17.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:17.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:17.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:18.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:18.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:18.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:18.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:19.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:19.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:19.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:19.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:20.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:20.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:20.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:20.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:21.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:21.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:21.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:21.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:22.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:22.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:22.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:22.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:23.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:23.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:23.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:23.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:24.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:24.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:24.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:24.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:25.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:25.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:25.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:25.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:26.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:26.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:26.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:26.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:27.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:27.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:27.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:27.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:28.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:28.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:28.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:28.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:29.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:29.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:29.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:29.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:30.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:30.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:30.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:30.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:31.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:31.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:31.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:31.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:32.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:32.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:32.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:32.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:33.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:33.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:33.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:33.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:34.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:34.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:34.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:34.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:35.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:35.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:35.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:35.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:36.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:36.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:36.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:36.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:37.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:37.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:37.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:37.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:38.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:38.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:38.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:38.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:39.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:39.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:39.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:39.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:40.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:40.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:40.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:40.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:41.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:41.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:41.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:41.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:42.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:42.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:42.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:42.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:43.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:43.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:43.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:43.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:44.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:44.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:44.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:44.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:45.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:45.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:45.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:45.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:46.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:46.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:46.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:46.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:47.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:47.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:47.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:47.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:48.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:48.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:48.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:48.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:49.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:49.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:49.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:49.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:50.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:50.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:50.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:50.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:51.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:51.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:51.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:51.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:52.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:52.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:52.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:52.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:53.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:53.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:53.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:53.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:54.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:54.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:54.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:54.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:55.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:55.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:55.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:55.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:56.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:56.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:56.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:56.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:57.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:57.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:57.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:57.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:58.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:58.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:58.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:58.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:59.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:00:59.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:00:59.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:00:59.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:00.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:00.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:00.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:00.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:01.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:01.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:01.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:01.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:02.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:02.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:02.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:02.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:03.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:03.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:03.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:03.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:04.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:04.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:04.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:04.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:05.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:05.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:05.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:05.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:06.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:06.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:06.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:06.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:07.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:07.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:07.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:07.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:08.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:08.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:08.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:08.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:09.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:09.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:09.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:09.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:10.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:10.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:10.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:10.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:11.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:11.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:11.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:11.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:12.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:12.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:12.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:12.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:13.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:13.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:13.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:13.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:14.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:14.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:14.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:14.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:15.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:15.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:15.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:15.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:16.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:16.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:16.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:16.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:17.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:17.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:17.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:17.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:18.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:18.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:18.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:18.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:19.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:19.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:19.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:19.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:20.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:20.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:20.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:20.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:21.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:21.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:21.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:21.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:22.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:22.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:22.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:22.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:23.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:23.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:23.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:23.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:24.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:24.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:24.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:24.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:25.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:25.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:25.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:25.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:26.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:26.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:26.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:26.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:27.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:27.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:27.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:27.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:28.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:28.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:28.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:28.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:29.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:29.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:29.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:29.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:30.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:30.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:30.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:30.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:31.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:31.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:31.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:31.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:32.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:32.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:32.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:32.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:33.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:33.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:33.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:33.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:34.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:34.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:34.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:34.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:35.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:35.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:35.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:35.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:36.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:36.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:36.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:36.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:37.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:37.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:37.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:37.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:38.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:38.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:38.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:38.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:39.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:39.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:39.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:39.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:40.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:40.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:40.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:40.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:41.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:41.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:41.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:41.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:42.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:42.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:42.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:42.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:43.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:43.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:43.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:43.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:44.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:44.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:44.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:44.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:45.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:45.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:45.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:45.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:46.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:46.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:46.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:46.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:47.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:47.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:47.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:47.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:48.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:48.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:48.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:48.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:49.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:49.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:49.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:49.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:50.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:50.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:50.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:50.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:51.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:51.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:51.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:51.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:52.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:52.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:52.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:52.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:53.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:53.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:53.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:53.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:54.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:54.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:54.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:54.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:55.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:55.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:55.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:55.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:56.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:56.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:56.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:56.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:57.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:57.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:57.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:57.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:58.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:58.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:58.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:58.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:59.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:01:59.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:01:59.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:01:59.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:00.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:00.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:00.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:00.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:01.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:01.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:01.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:01.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:02.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:02.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:02.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:02.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:03.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:03.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:03.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:03.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:04.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:04.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:04.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:04.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:05.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:05.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:05.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:05.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:06.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:06.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:06.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:06.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:07.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:07.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:07.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:07.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:08.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:08.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:08.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:08.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:09.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:09.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:09.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:09.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:10.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:10.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:10.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:10.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:11.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:11.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:11.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:11.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:12.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:12.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:12.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:12.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:13.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:13.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:13.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:13.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:14.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:14.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:14.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:14.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:15.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:15.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:15.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:15.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:16.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:16.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:16.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:16.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:17.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:17.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:17.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:17.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:18.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:18.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:18.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:18.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:19.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:19.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:19.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:19.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:20.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:20.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:20.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:20.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:21.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:21.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:21.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:21.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:22.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:22.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:22.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:22.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:23.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:23.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:23.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:23.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:24.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:24.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:24.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:24.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:25.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:25.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:25.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:25.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:26.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:26.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:26.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:26.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:27.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:27.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:27.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:27.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:28.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:28.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:28.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:28.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:29.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:29.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:29.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:29.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:30.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:30.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:30.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:30.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:31.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:31.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:31.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:31.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:32.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:32.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:32.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:32.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:33.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:33.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:33.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:33.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:34.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:34.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:34.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:34.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:35.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:35.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:35.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:35.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:36.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:36.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:36.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:36.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:37.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:37.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:37.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:37.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:38.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:38.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:38.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:38.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:39.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:39.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:39.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:39.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:40.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:40.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:40.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:40.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:41.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:41.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:41.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:41.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:42.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:42.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:42.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:42.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:43.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:43.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:43.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:43.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:44.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:44.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:44.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:44.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:45.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:45.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:45.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:45.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:46.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:46.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:46.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:46.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:47.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:47.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:47.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:47.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:48.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:48.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:48.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:48.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:49.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:49.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:49.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:49.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:50.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:50.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:50.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:50.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:51.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:51.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:51.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:51.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:52.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:52.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:52.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:52.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:53.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:53.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:53.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:53.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:54.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:54.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 46 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:54.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:54.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:55.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:55.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:55.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:55.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:56.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:56.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:56.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:56.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:57.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:57.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:57.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:57.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:58.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:58.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:58.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:58.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:59.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:02:59.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:02:59.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:02:59.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:00.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:00.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:00.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:00.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:01.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:01.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:01.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:01.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:02.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:02.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:02.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:02.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:03.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:03.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:03.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:03.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:04.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:04.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:04.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:04.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:05.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:05.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:05.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:05.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:06.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:06.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:06.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:06.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:07.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:07.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:07.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:07.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:08.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:08.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:08.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:08.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:09.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:09.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:09.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:09.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:10.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:10.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:10.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:10.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:11.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:11.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:11.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:11.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:12.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:12.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:12.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:12.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:13.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:13.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:13.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:13.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:14.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:14.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:14.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:14.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:15.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:15.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:15.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:15.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:16.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:16.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:16.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:16.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:17.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:17.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:17.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:17.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:18.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:18.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:18.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:18.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:19.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:19.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:19.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:19.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:20.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:20.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:20.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:20.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:21.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:21.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:21.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:21.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:22.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:22.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:22.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:22.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:23.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:23.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:23.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:23.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:24.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:24.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:24.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:24.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:25.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:25.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:25.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:25.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:26.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:26.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:26.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:26.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:27.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:27.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:27.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:27.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:28.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:28.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:28.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:28.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:29.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:29.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:29.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:29.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:30.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:30.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:30.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:30.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:31.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:31.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:31.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:31.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:32.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:32.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:32.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:32.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:33.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:33.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:33.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:33.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:34.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:34.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:34.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:34.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:35.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:35.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:35.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:35.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:36.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:36.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:36.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:36.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:37.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:37.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:37.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:37.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:38.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:38.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:38.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:38.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:39.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:39.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:39.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:39.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:40.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:40.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:40.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:40.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:41.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:41.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:41.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:41.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:42.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:42.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:42.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:42.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:43.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:43.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:43.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:43.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:44.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:44.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:44.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:44.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:45.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:45.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:45.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:45.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:46.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:46.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:46.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:46.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:47.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:47.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:47.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:47.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:48.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:48.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:48.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:48.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:49.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:49.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:49.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:49.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:50.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:50.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:50.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:50.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:51.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:51.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:51.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:51.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:52.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:52.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:52.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:52.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:53.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:53.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:53.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:53.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:54.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:54.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:54.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:54.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:55.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:55.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:55.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:55.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:56.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:56.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:56.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:56.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:57.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:57.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:57.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:57.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:58.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:58.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:58.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:58.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:59.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:03:59.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:03:59.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:03:59.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:00.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:00.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:00.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:00.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:01.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:01.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:01.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:01.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:02.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:02.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:02.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:02.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:03.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:03.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:03.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:03.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:04.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:04.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:04.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:04.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:05.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:05.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:05.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:05.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:06.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:06.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:06.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:06.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:07.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:07.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:07.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:07.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:08.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:08.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:08.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:08.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:09.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:09.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:09.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:09.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:10.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:10.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:10.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:10.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:11.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:11.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:11.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:11.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:12.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:12.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:12.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:12.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:13.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:13.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:13.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:13.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:14.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:14.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:14.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:14.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:15.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:15.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:15.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:15.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:16.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:16.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:16.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:16.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:17.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:17.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:17.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:17.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:18.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:18.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:18.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:18.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:19.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:19.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:19.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:19.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:20.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:20.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:20.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:20.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:21.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:21.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:21.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:21.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:22.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:22.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:22.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:22.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:23.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:23.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:23.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:23.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:24.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:24.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:24.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:24.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:25.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:25.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:25.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:25.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:26.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:26.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:26.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:26.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:27.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:27.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:27.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:27.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:28.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:28.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:28.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:28.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:29.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:29.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:29.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:29.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:30.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:30.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:30.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:30.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:31.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:31.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:31.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:31.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:32.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:32.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:32.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:32.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:33.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:33.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:33.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:33.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:34.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:34.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:34.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:34.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:35.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:35.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:35.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:35.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:36.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:36.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:36.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:36.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:37.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:37.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:37.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:37.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:38.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:38.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:38.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:38.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:39.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:39.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:39.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:39.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:40.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:40.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:40.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:40.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:41.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:41.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:41.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:41.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:42.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:42.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:42.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:42.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:43.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:43.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:43.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:43.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:44.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:44.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:44.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:44.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:45.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:45.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:45.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:45.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:46.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:46.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:46.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:46.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:47.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:47.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:47.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:47.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:48.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:48.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:48.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:48.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:49.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:49.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:49.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:49.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:50.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:50.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:50.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:50.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:51.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:51.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:51.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:51.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:52.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:52.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:52.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:52.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:53.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:53.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:53.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:53.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:54.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:54.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:54.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:54.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:55.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:55.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:55.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:55.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:56.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:56.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:56.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:56.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:57.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:57.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:57.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:57.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:58.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:58.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:58.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:58.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:59.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:04:59.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:04:59.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:04:59.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:00.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:00.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:00.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:00.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:01.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:01.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:01.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:01.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:02.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:02.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:02.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:02.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:03.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:03.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:03.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:03.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:04.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:04.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:04.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:04.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:05.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:05.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:05.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:05.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:06.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:06.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:06.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:06.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:07.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:07.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:07.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:07.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:08.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:08.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:08.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:08.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:09.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:09.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:09.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:09.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:10.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:10.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:10.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:10.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:11.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:11.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:11.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:11.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:12.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:12.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:12.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:12.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:13.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:13.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:13.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:13.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:14.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:14.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:14.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:14.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:15.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:15.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:15.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:15.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:16.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:16.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:16.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:16.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:17.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:17.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:17.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:17.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:18.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:18.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:18.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:18.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:19.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:19.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:19.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:19.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:20.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:20.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:20.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:20.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:21.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:21.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:21.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:21.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:22.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:22.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:22.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:22.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:23.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:23.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:23.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:23.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:24.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:24.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:24.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:24.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:25.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:25.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:25.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:25.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:26.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:26.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:26.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:26.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:27.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:27.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:27.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:27.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:28.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:28.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:28.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:28.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:29.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:29.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:29.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:29.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:30.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:30.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:30.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:30.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:31.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:31.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:31.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:31.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:32.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:32.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:32.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:32.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:33.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:33.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:33.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:33.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:34.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:34.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:34.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:34.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:35.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:35.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:35.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:35.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:36.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:36.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:36.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:36.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:37.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:37.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:37.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:37.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:38.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:38.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:38.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:38.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:39.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:39.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:39.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:39.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:40.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:40.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:40.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:40.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:41.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:41.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:41.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:41.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:42.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:42.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:42.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:42.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:43.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:43.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:43.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:43.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:44.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:44.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:44.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:44.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:45.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:45.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:45.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:45.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:46.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:46.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:46.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:46.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:47.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:47.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:47.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:47.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:48.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:48.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:48.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:48.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:49.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:49.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:49.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:49.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:50.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:50.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:50.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:50.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:51.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:51.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:51.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:51.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:52.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:52.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:52.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:52.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:53.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:53.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:53.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:53.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:54.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:54.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:54.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:54.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:55.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:55.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:55.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:55.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:56.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:56.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:56.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:56.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:57.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:57.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:57.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:57.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:58.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:58.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:58.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:58.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:59.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:05:59.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:05:59.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:05:59.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:00.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:00.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:00.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:00.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:01.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:01.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:01.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:01.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:02.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:02.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:02.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:02.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:03.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:03.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:03.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:03.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:04.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:04.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:04.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:04.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:05.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:05.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:05.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:05.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:06.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:06.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:06.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:06.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:07.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:07.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:07.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:07.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:08.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:08.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:08.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:08.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:09.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:09.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:09.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:09.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:10.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:10.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:10.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:10.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:11.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:11.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:11.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:11.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:12.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:12.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:12.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:12.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:13.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:13.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:13.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:13.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:14.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:14.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:14.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:14.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:15.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:15.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:15.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:15.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:16.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:16.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:16.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:16.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:17.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:17.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:17.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:17.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:18.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:18.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:18.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:18.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:19.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:19.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:19.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:19.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:20.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:20.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:20.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:20.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:21.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:21.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:21.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:21.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:22.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:22.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:23.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:23.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:23.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:23.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:24.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:24.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:24.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:24.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:25.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:25.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:25.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:25.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:26.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:26.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:26.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:26.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:27.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:27.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:27.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:27.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:28.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:28.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:28.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:28.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:29.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:29.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:29.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:29.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:30.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:30.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:30.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:30.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:31.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:31.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:31.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:31.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:32.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:32.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:32.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:32.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:33.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:33.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:33.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:33.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:34.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:34.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:34.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:34.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:35.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:35.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:35.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:35.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:36.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:36.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:36.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:36.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:37.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:37.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:37.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:37.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:38.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:38.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:38.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:38.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:39.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:39.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:39.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:39.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:40.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:40.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:40.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:40.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:41.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:41.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:41.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:41.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:42.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:42.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:42.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:42.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:43.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:43.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:43.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:43.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:44.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:44.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:44.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:44.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:45.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:45.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:45.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:45.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:46.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:46.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:46.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:46.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:47.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:47.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:47.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:47.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:48.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:48.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:48.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:48.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:49.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:49.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:49.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:49.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:50.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:50.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:50.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:50.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:51.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:51.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:51.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:51.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:52.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:52.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:52.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:52.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:53.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:53.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:53.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:53.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:54.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:54.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:54.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:54.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:55.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:55.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:55.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:55.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:56.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:56.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:56.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:56.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:57.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:57.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:57.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:57.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:58.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:58.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:58.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:58.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:59.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:06:59.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:06:59.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:06:59.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:00.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:00.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:00.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:00.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:00.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:00.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:01.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:01.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:01.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:01.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:02.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:02.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:02.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:02.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:03.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:03.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:03.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:03.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:04.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:04.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:04.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:04.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:05.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:05.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:06.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:06.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:06.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:06.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:07.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:07.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:07.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:07.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:08.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:08.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:08.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:08.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:09.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:09.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:09.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:09.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:10.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:10.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:10.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:10.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:11.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:11.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:11.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:11.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:12.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:12.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:12.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:12.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:13.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:13.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:13.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:13.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:14.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:14.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:14.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:14.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:15.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:15.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:15.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:15.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:16.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:16.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:16.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:16.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:17.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:17.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:17.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:17.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:18.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:18.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:18.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:18.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:19.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:19.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:19.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:19.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:20.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:20.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:20.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:20.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:21.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:21.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:21.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:21.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:22.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:22.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:22.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:22.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:23.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:23.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:23.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:23.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:24.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:24.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:24.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:24.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:25.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:25.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:25.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:25.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:26.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:26.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:26.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:26.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:27.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:27.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:27.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:27.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:28.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:28.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:28.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:28.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:29.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:29.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:29.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:29.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:30.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:30.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:30.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:30.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:31.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:31.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:31.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:31.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:32.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:32.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:32.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:32.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:33.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:33.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:33.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:33.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:34.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:34.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:34.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:34.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:35.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:35.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:35.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:35.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:36.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:36.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:36.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:36.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:37.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:37.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:37.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:37.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:38.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:38.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:38.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:38.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:39.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:39.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:39.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:39.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:40.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:40.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:40.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:40.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:41.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:41.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:41.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:41.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:42.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:42.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:42.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:42.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:43.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:43.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:43.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:43.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:44.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:44.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:44.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:44.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:45.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:45.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:45.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:45.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:46.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:46.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:46.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:46.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:47.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:47.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:47.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:47.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:48.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:48.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:48.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:48.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:49.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:49.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:49.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:49.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:49.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:50.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:50.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:50.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:51.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:51.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:51.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:51.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:52.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:52.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:52.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:52.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:53.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:53.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:53.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:53.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:54.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:54.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:54.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:54.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:55.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:55.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:55.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:55.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:56.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:56.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:56.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:56.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:57.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:57.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:57.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:57.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:58.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:58.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:58.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:58.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:59.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:07:59.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:07:59.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:07:59.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:00.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:00.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:00.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:00.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:01.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:01.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:01.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:01.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:02.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:02.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:02.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:02.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:03.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:03.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:03.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:03.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:04.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:04.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:04.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:04.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:05.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:05.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:05.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:05.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:06.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:06.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:06.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:06.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:07.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:07.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:07.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:07.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:08.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:08.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:08.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:08.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:09.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:09.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:09.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:09.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:10.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:10.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:10.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:10.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:11.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:11.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:11.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:11.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:12.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:12.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:12.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:12.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:13.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:13.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:13.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:13.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:14.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:14.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:14.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:14.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:15.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:15.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:15.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:15.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:16.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:16.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:16.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:16.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:17.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:17.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:17.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:17.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:18.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:18.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:18.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:18.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:19.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:19.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:19.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:19.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:20.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:20.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:20.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:20.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:21.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:21.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:21.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:21.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:22.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:22.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:22.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:22.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:23.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:23.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:23.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:23.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:24.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:24.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:24.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:24.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:25.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:25.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:25.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:25.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:26.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:26.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:26.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:26.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:27.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:27.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:27.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:27.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:28.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:28.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:28.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:28.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:29.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:29.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:29.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:29.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:30.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:30.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:30.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:30.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:31.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:31.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:31.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:31.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:32.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:32.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:32.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:32.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:33.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:33.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:33.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:33.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:34.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:34.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:34.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:34.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:35.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:35.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:35.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:35.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:36.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:36.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:36.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:36.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:37.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:37.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:37.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:37.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:38.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:38.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:38.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:38.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:39.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:39.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:39.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:39.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:40.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:40.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:40.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:40.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:41.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:41.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:41.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:41.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:42.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:42.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:42.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:42.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:43.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:43.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:43.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:43.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:44.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:44.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:44.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:44.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:45.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:45.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:45.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:45.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:45.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:45.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:46.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:46.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:46.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:46.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:47.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:47.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:47.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:47.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:48.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:48.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:48.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:48.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:49.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:49.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:49.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:49.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:50.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:50.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:50.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:50.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:51.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:51.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:51.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:52.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:52.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:52.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:53.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:53.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:53.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:53.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:54.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:54.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:54.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:54.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:54.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:54.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:55.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:55.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:56.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:56.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:56.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:56.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:56.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:57.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:57.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:57.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:57.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:57.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:58.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:58.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:58.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:58.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:59.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:08:59.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:08:59.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:08:59.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:00.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:00.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:00.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:00.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:01.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:01.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:01.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:01.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:02.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:02.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:02.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:02.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:03.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:03.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:03.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:03.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:04.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:04.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:04.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:04.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:05.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:05.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:05.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:05.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:06.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:06.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:06.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:06.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:07.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:07.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:07.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:07.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:08.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:08.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:08.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:08.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:09.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:09.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:09.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:10.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:10.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:10.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:10.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:10.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:11.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:11.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:11.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:11.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:12.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:12.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:12.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:12.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:13.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:13.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:13.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:13.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:14.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:14.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:14.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:14.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:15.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:15.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:15.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:15.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:16.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:16.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:16.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:16.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:17.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:17.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:17.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:17.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:18.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:18.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:18.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:18.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:19.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:19.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:19.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:19.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:20.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:20.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:20.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:20.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:21.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:21.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:21.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:21.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:22.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:22.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:22.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:22.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:23.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:23.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:23.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:23.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:24.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:24.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:24.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:24.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:25.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:25.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:25.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:25.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:26.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:26.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:26.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:26.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:26.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:26.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:27.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:27.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:27.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:27.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:28.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:28.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:28.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:28.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:29.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:29.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:29.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:29.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:30.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:30.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:30.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:30.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:31.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:31.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:31.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:31.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:32.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:32.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:32.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:32.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:33.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:33.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:33.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:33.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:34.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:34.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:34.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:34.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:35.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:35.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:35.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:35.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:36.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:36.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:36.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:36.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:37.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:37.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:37.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:37.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:38.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:38.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:38.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:38.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:39.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:39.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:39.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:39.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:40.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:40.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:41.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:41.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:41.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:41.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:42.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:42.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:42.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:42.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:43.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:43.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:43.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:43.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:44.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:44.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:44.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:44.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:45.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:45.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:45.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:45.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:46.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:46.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:46.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:46.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:47.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:47.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:48.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:47.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:48.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:48.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:48.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:48.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:49.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:49.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:49.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:49.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:50.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:50.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:50.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:50.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:51.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:51.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:51.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:51.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:52.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:52.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:52.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:52.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:53.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:53.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:53.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:53.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:54.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:54.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:54.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:54.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:55.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:55.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:55.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:55.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:56.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:56.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:56.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:56.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:57.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:57.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:57.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:57.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:58.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:58.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:58.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:58.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:59.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:09:59.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:09:59.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:09:59.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:00.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:00.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:00.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:00.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:01.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:01.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:01.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:01.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:02.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:02.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:02.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:02.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:03.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:03.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:03.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:03.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:04.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:04.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:04.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:04.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:05.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:05.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:05.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:05.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:06.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:06.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:06.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:06.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:07.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:07.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:07.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:07.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:08.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:08.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:08.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:08.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:09.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:09.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:09.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:09.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:10.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:10.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:10.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:10.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:11.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:11.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:11.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:11.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:12.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:12.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:13.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:13.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:13.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:13.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:13.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:13.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:14.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:14.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:15.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:15.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:15.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:15.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:16.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:16.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:16.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:16.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:17.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:17.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:17.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:17.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:18.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:18.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:18.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:18.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:19.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:19.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:19.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:19.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:20.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:20.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:20.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:20.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:21.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:21.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:21.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:21.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:22.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:22.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:22.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:22.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:23.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:23.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:23.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:23.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:24.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:24.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:24.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:24.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:25.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:25.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:25.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:25.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:26.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:26.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:26.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:26.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:27.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:27.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:27.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:27.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:28.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:28.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:28.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:28.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:29.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:29.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:29.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:29.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:30.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:30.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:30.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:30.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:31.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:31.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:31.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:31.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:32.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:32.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:32.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:32.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:33.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:33.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:33.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:33.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:34.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:34.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:34.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:34.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:35.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:35.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:35.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:35.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:36.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:36.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:36.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:36.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:37.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:37.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:37.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:37.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:38.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:38.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:38.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:38.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:39.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:39.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:39.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:39.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:40.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:40.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:40.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:40.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:41.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:41.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:41.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:41.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:42.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:42.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:42.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:42.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:43.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:43.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:43.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:43.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:44.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:44.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:44.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:44.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:45.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:45.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:45.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:45.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:46.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:46.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:46.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:46.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:47.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:47.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:47.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:47.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:48.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:48.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:48.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:48.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:49.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:49.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:49.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:49.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:50.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:50.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:50.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:50.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:51.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:51.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:51.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:51.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:52.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:52.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:52.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:52.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:53.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:53.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:53.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:53.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:54.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:54.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:54.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:54.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:55.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:55.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:55.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:55.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:56.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:56.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:56.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:56.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:57.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:57.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:57.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:57.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:58.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:58.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:58.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:58.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:59.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:10:59.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:10:59.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:10:59.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:00.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:00.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:00.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:00.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:01.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:01.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:01.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:01.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:02.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:02.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:02.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:02.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:03.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:03.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:03.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:03.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:04.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:04.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:04.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:04.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:05.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:05.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:05.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:05.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:06.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:06.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:06.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:06.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:07.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:07.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:07.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:07.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:08.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:08.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:08.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:08.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:09.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:09.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:09.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:09.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:10.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:10.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:10.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:10.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:11.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:11.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:11.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:11.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:12.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:12.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:12.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:12.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:13.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:13.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:13.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:13.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:14.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:14.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:14.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:14.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:15.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:15.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:15.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:15.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:16.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:16.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:16.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:16.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:17.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:17.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:17.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:17.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:17.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:17.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:18.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:18.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:18.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:18.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:19.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:19.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:19.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:19.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:20.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:20.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:21.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:21.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:21.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:21.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:22.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:22.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:22.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:22.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:22.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:23.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:23.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:23.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:24.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:24.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:24.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:24.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:25.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:25.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:25.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:25.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:26.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:26.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:26.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:26.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:27.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:27.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:27.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:27.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:28.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:28.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:28.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:28.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:28.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:28.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:28.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:29.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:29.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:29.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:29.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:29.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:30.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:30.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:30.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:30.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:31.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:31.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:31.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:31.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:32.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:32.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:32.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:32.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:33.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:33.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:33.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:33.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:34.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:34.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:34.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:34.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:35.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:35.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:35.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:35.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:36.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:36.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:36.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:36.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:37.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:37.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:37.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:37.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:38.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:38.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:38.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:38.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:39.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:39.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:39.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:39.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:40.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:40.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:40.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:40.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:41.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:41.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:41.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:41.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:42.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:42.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:42.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:42.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:43.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:43.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:43.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:43.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:44.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:44.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:45.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:45.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:45.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:45.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:46.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:46.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:46.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:46.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:46.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:46.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:47.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:47.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:48.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:48.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:48.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:48.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:48.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:49.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:49.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:49.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:49.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:49.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:50.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:50.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:51.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:51.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:51.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:51.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:51.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:51.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:52.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:52.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:52.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:52.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:53.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:53.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:53.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:53.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:54.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:54.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:54.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:54.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:55.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:55.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:55.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:55.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:56.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:56.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:56.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:56.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:57.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:57.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:57.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:57.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:58.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:58.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:58.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:58.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:59.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:11:59.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:11:59.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:11:59.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:00.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:00.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:00.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:00.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:01.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:01.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:01.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:01.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:02.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:02.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:02.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:02.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:03.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:03.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:03.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:03.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:04.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:04.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:04.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:04.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:05.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:05.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:05.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:05.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:06.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:06.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:06.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:06.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:07.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:07.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:07.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:07.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:08.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:08.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:08.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:08.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:09.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:09.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:09.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:09.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:10.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:10.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:10.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:10.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:11.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:11.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:11.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:11.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:12.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:12.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:12.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:12.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:13.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:13.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:13.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:14.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:14.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:14.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:15.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:15.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:15.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:15.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:16.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:16.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:16.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:16.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:17.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:17.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:17.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:17.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:18.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:18.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:18.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:18.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:19.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:19.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:19.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:19.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:20.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:20.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:20.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:20.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:21.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:21.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:21.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:21.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:22.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:22.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:22.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:22.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:22.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:23.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:23.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:23.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:24.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:24.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:24.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:24.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:25.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:25.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:25.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:25.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:26.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:26.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:26.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:26.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:27.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:27.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:27.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:27.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:27.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:28.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:28.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:28.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:28.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:28.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:29.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:29.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:29.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:29.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:30.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:30.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:30.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:30.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:31.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:31.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:31.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:31.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:32.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:32.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:32.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:33.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:33.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:33.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:34.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:34.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:34.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:34.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:34.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:35.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:35.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:35.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:36.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:36.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:36.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:36.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:37.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:37.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:37.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:37.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:37.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:37.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:38.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:38.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:38.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:38.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:39.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:39.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:39.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:39.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:40.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:40.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:41.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:41.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:41.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:41.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:42.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:42.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:42.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:42.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:43.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:43.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:43.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:43.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:44.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:44.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:44.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:44.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:45.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:45.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:45.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:45.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:46.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:46.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:46.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:46.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:47.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:47.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:47.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:47.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:48.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:48.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:48.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:48.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:49.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:49.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:49.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:49.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:50.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:50.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:50.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:50.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:51.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:51.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:51.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:51.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:52.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:52.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:52.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:52.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:53.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:53.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:54.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:54.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:54.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:54.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:55.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:55.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:55.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:55.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:56.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:56.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:56.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:56.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:57.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:57.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:57.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:57.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:58.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:58.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:58.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:58.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:59.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:12:59.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:12:59.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:12:59.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:00.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:00.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:00.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:00.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:01.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:01.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:01.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:01.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:02.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:02.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:02.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:02.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:03.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:03.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:03.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:03.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:04.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:04.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:04.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:04.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:05.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:05.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:05.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:05.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:06.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:06.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:06.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:06.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:07.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:07.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:07.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:07.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:08.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:08.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:08.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:08.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:09.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:09.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:09.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:09.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:10.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:10.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:10.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:10.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:10.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:10.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:10.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:11.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:11.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:11.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:12.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:12.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:12.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:12.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:13.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:13.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:13.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:13.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:14.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:14.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:14.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:14.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:15.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:15.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:15.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:15.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:16.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:16.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:16.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:16.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:17.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:17.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:17.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:17.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:18.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:18.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:18.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:19.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:18.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:19.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:19.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:19.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:20.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:20.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:20.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:20.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:21.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:21.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:21.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:21.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:21.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:21.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:22.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:22.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:23.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:23.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:23.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:23.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:24.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:24.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:24.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:24.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:25.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:25.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:25.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:25.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:26.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:26.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:26.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:26.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:27.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:27.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:27.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:27.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:28.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:28.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:28.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:28.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:29.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:29.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:29.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:29.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:30.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:30.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:30.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:30.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:31.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:31.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:31.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:31.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:32.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:32.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:32.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:32.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:33.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:33.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:33.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:33.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:34.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:34.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:34.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:34.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:35.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:35.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:35.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:35.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:36.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:36.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:36.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:36.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:37.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:37.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:37.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:37.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:38.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:38.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:38.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:38.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:39.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:39.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:39.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:39.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:40.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:40.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:40.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:41.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:41.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:41.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:42.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:42.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:42.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:42.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:43.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:43.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:43.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:43.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:44.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:44.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:44.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:44.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:45.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:45.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:45.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:45.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:46.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:46.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:46.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:46.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:46.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:47.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:47.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:47.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:48.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:48.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:48.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:48.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:49.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:49.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:49.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:49.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:49.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:49.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:50.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:50.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:50.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:50.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:51.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:51.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:51.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:51.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:52.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:52.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:52.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:52.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:53.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:53.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:53.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:53.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:54.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:54.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:54.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:54.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:55.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:55.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:55.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:55.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:56.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:56.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:56.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:56.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:57.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:57.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:57.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:57.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:58.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:58.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:59.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:13:59.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:59.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:13:59.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:13:59.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:00.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:00.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:00.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:01.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:01.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:01.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:01.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:02.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:02.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:02.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:02.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:03.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:03.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:03.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:03.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:04.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:04.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:04.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:04.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:05.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:05.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:05.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:05.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:06.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:06.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:06.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:06.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:07.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:07.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:07.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:07.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:08.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:08.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:08.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:08.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:09.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:09.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:09.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:09.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:10.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:10.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:10.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:10.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:11.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:11.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:11.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:11.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:12.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:12.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:12.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:12.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:13.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:13.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:13.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:13.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:13.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:13.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:14.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:14.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:14.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:14.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:15.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:15.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:15.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:15.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:16.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:16.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:17.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:17.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:17.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:17.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:18.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:18.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:18.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:18.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:19.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:19.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:19.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:19.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:20.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:20.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:20.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:20.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:21.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:21.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:21.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:21.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:22.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:22.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:22.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:22.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:23.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:23.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:23.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:23.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:24.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:24.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:24.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:24.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:25.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:25.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:25.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:25.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:26.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:26.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:26.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:26.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:27.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:27.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:27.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:27.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:28.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:28.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:28.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:28.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:29.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:29.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:29.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:29.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:30.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:30.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:30.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:30.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:31.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:31.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:31.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:31.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:31.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:31.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:32.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:32.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:33.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:33.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:33.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:33.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:33.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:33.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:34.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:34.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:34.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:34.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:35.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:35.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 75 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:35.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:35.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:36.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:36.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:36.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:36.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:37.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:37.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:37.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:37.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:38.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:38.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:38.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:38.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:39.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:39.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:39.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:39.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:40.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:40.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:40.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:40.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:41.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:41.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:41.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:41.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:42.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:42.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:42.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:42.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:43.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:43.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:43.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:43.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:44.089 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T21:14:44.099+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac125ae0 msgr2=0x7f81ac0ca6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T21:14:44.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:44.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:44.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:44.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:45.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:45.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:45.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:45.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:46.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:46.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:46.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:47.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:47.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:47.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:48.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:48.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:48.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:48.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:49.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:49.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:49.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:49.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:49.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:49.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:50.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:50.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:50.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:50.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:51.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:51.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:51.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:51.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:52.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:52.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:52.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:52.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:53.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:53.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:54.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:54.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:54.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:54.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:55.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:55.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:55.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:55.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:56.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:56.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:56.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:56.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:57.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:57.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:57.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:57.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:58.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:58.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:58.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:58.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:14:59.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:14:59.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:14:59.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:14:59.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:15:00.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:00.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:00.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:00.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:15:01.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:01.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:01.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:01.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:15:01.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:01.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:02.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:02.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:15:02.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:02.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:03.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:03.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:15:03.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:03.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:04.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:04.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:15:04.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:04.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:05.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:05.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 10 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:15:05.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:05.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:06.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:06.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:06.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:06.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:07.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:07.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:07.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:07.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:08.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:08.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:08.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:08.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:09.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:09.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:09.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:09.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:10.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:10.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:10.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:10.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:11.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:11.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:11.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:11.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:12.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:12.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:12.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:12.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:13.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:13.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:13.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:13.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:14.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:14.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:14.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:14.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:15.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:15.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:15.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:15.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:16.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:16.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:16.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:16.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:17.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:17.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:17.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:17.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:18.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:18.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:18.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:18.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:19.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:19.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:19.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:19.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:20.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:20.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:20.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:20.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:21.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:21.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:21.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:21.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:22.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:22.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:22.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:22.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:23.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:23.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:23.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:23.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:24.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:24.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:24.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:24.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:25.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:25.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:25.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:25.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:26.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:26.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:26.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:26.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:27.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:27.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:27.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:27.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:28.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:28.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:28.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:28.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:29.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:29.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:29.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:29.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:30.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:30.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:30.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:30.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:31.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:31.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:31.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:31.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:32.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:32.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:32.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:32.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:33.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:33.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:33.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:33.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:34.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:34.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:34.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:34.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:35.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:35.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:35.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:35.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:36.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:36.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:36.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:36.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:37.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:37.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:37.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:37.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:38.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:38.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:38.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:38.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:39.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:39.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:39.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:39.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:40.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:40.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:40.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:40.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:41.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:41.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:41.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:41.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:42.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:42.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:42.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:42.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:43.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:43.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:43.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:43.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:44.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:44.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:44.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:44.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:45.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:45.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:45.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:45.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:46.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:46.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:46.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:46.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:47.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:47.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:47.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:47.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:48.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:48.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:48.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:48.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:49.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:49.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:49.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:49.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:50.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:50.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:50.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:50.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:51.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:51.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:51.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:51.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:52.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:52.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:52.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:52.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:53.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:53.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:53.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:53.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:54.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:54.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:54.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:54.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:55.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:55.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:55.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:55.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:56.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:56.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:56.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:56.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:57.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:57.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:57.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:57.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:58.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:58.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:58.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:58.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:59.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:15:59.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:15:59.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:15:59.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:00.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:00.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:00.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:00.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:01.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:01.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:01.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:01.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:02.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:02.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:02.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:02.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:03.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:03.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:03.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:03.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:04.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:04.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:04.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:04.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:05.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:05.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:05.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:05.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:06.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:06.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:06.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:06.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:07.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:07.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:07.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:07.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:08.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:08.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:08.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:08.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:09.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:09.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:09.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:09.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:10.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:10.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:10.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:10.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:11.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:11.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:11.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:11.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:12.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:12.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:12.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:12.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:13.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:13.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:13.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:13.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:14.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:14.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:14.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:14.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:15.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:15.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:15.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:15.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:16.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:16.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:16.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:16.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:17.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:17.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:17.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:17.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:18.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:18.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:18.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:18.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:19.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:19.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:19.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:19.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:20.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:20.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:20.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:20.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:21.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:21.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:21.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:21.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:22.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:22.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:22.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:22.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:23.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:23.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:23.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:23.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:24.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:24.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:24.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:24.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:25.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:25.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:25.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:25.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:26.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:26.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:26.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:26.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:27.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:27.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:27.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:27.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:28.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:28.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:28.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:28.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:29.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:29.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:29.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:29.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:30.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:30.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:30.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:30.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:31.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:31.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:31.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:31.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:32.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:32.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:32.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:32.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:33.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:33.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:33.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:33.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:34.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:34.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:34.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:34.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:35.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:35.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:35.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:35.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:36.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:36.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:36.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:36.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:37.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:37.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:37.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:37.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:38.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:38.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:38.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:38.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:39.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:39.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:39.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:39.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:40.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:40.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:40.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:40.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:41.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:41.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:41.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:41.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:42.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:42.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:42.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:42.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:43.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:43.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:43.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:43.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:44.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:44.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:44.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:44.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:45.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:45.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:46.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:46.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:46.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:46.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:46.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:46.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:47.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:47.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:48.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:48.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:48.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:48.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:48.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:49.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:49.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:49.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:50.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:50.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:50.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:50.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:51.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:51.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:51.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:51.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:52.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:52.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:52.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:52.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:53.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:53.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:53.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:53.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:54.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:54.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:54.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:54.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:55.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:55.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:55.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:55.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:56.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:56.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:56.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:56.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:57.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:57.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:57.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:57.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:58.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:58.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:58.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:58.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:59.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:16:59.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:16:59.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:16:59.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:00.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:00.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:00.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:00.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:01.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:01.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:01.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:01.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:02.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:02.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:02.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:02.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:03.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:03.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:03.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:03.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:04.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:04.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:04.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:04.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:05.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:05.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:05.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:05.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:06.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:06.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:06.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:06.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:07.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:07.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:07.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:07.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:08.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:08.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:08.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:08.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:09.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:09.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:09.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:09.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:10.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:10.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:10.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:10.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:11.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:11.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:11.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:11.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:12.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:12.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:12.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:12.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:13.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:13.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:13.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:13.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:14.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:14.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:14.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:14.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:15.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:15.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:15.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:15.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:16.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:16.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:16.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:16.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:17.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:17.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:17.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:17.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:18.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:18.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:18.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:18.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:19.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:19.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:20.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:20.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:20.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:20.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:20.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:20.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:21.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:21.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:21.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:21.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:22.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:22.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:22.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:22.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:23.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:23.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:24.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:24.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:24.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:24.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:25.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:25.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:25.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:25.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:26.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:26.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:26.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:26.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:27.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:27.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:27.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:27.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:28.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:28.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:28.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:28.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:29.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:29.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:29.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:29.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:30.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:30.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:30.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:30.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:31.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:31.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:31.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:31.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:31.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:32.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:32.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:32.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:32.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:32.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:33.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:33.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:33.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:33.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:34.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:34.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:34.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:34.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:35.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:35.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:35.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:35.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:36.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:36.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:36.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:36.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:37.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:37.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:37.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:37.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:38.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:38.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:38.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:38.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:39.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:39.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:39.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:39.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:40.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:40.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:40.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:40.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:41.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:41.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:41.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:41.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:42.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:42.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:42.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:42.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:43.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:43.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:43.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:43.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:44.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:44.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:44.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:44.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:45.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:45.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:45.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:45.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:46.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:46.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:46.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:46.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:47.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:47.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:47.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:47.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:48.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:48.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:48.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:48.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:49.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:49.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:49.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:49.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:50.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:50.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:50.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:50.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:51.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:51.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:51.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:51.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:52.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:52.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:52.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:52.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:53.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:53.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:53.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:53.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:54.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:54.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:54.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:54.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:55.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:55.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:55.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:55.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:56.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:56.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:56.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:56.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:57.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:57.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:57.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:57.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:58.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:58.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:58.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:58.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:59.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:17:59.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:17:59.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:17:59.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:00.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:00.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:00.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:00.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:01.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:01.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:01.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:02.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:02.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:02.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:02.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:02.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:03.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:03.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:03.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:03.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:04.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:04.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:04.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:04.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:05.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:05.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:06.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:06.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:06.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:06.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:07.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:07.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:07.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:07.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:08.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:08.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:08.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:08.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:09.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:09.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:09.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:09.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:10.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:10.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:10.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:10.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:11.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:11.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:11.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:11.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:12.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:12.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:12.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:12.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:13.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:13.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:13.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:13.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:14.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:14.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:14.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:14.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:14.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:15.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:15.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:15.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:16.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:16.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:16.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:16.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:17.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:17.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:17.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:17.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:17.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:17.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:18.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:18.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:18.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:19.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:19.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:19.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:20.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:20.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:20.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:20.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:21.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:21.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:21.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:21.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:22.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:22.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:22.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:22.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:22.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:22.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:23.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:23.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:23.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:23.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:24.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:24.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:24.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:25.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:25.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:25.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:25.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:25.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:26.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:26.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:26.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:26.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:27.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:27.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:28.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:28.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:28.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:28.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:28.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:28.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:29.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:29.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:30.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:30.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:30.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:30.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:31.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:31.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:31.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:31.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:32.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:32.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:32.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:32.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:33.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:33.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:33.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:33.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:34.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:34.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:34.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:34.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:35.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:35.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:35.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:35.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:35.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:35.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:36.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:36.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:36.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:37.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:37.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:37.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:38.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:38.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:38.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:38.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:38.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:38.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:39.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:39.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:39.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:39.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:40.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:40.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:40.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:40.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:41.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:41.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:41.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:41.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:42.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:42.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:42.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:42.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:43.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:43.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:43.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:43.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:44.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:44.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:44.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:44.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:45.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:45.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:45.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:45.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:46.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:46.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:46.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:46.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:47.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:47.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:48.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:48.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:48.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:48.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:49.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:49.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:49.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:49.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:50.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:50.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:50.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:50.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:51.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:51.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:51.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:51.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:51.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:51.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:52.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:52.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:53.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:53.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:53.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:53.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:54.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:54.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:54.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:54.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:54.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:55.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:55.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:55.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:55.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:55.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:56.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:56.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:56.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:56.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:57.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:57.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:57.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:57.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:58.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:58.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:58.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:58.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:59.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:18:59.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:18:59.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:18:59.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:00.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:00.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:00.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:00.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:01.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:01.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:01.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:01.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:02.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:02.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:02.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:02.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:03.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:03.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:03.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:03.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:04.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:04.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:04.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:04.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:05.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:05.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:05.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:05.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:06.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:06.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:06.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:06.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:07.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:07.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:07.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:07.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:08.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:08.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:08.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:08.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:09.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:09.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:10.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:10.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:10.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:10.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:11.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:11.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:11.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:11.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:11.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:12.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:12.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:12.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:13.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:13.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:13.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:13.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:14.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:14.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:14.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:14.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:15.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:15.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:15.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:15.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:16.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:16.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:16.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:16.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:17.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:17.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:17.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:17.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:18.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:18.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:18.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:18.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:19.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:19.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:19.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:19.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:20.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:20.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:20.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:20.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:21.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:21.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:21.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:21.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:22.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:22.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:22.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:22.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:23.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:23.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:23.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:23.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:24.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:24.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:24.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:24.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:25.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:25.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:25.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:25.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:26.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:26.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:26.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:26.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:27.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:27.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:27.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:27.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:28.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:28.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:28.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:28.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:29.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:29.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:29.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:29.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:30.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:30.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:30.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:30.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:31.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:31.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:31.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:31.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:32.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:32.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:32.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:32.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:33.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:33.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:33.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:33.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:34.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:34.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:34.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:34.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:35.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:35.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:35.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:35.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:36.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:36.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:36.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:36.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:37.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:37.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:37.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:37.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:38.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:38.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:38.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:38.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:39.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:39.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:39.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:39.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:40.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:40.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:40.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:40.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:41.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:41.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:41.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:41.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:42.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:42.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:42.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:42.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:43.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:43.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:43.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:43.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:44.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:44.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:44.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:44.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:45.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:45.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:45.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:45.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:46.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:46.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:46.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:46.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:47.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:47.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:47.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:47.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:48.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:48.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:48.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:48.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:49.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:49.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:49.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:49.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:50.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:50.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:50.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:50.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:51.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:51.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:51.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:51.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:52.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:52.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:52.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:52.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:53.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:53.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:53.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:53.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:54.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:54.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:54.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:54.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:55.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:55.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:55.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:55.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:56.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:56.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:56.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:56.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:57.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:57.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:57.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:57.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:58.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:58.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:58.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:58.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:59.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:19:59.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:19:59.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:19:59.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:00.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:00.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:00.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:00.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:01.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:01.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:01.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:01.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:02.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:02.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:02.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:02.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:03.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:03.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:03.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:03.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:04.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:04.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:04.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:04.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:05.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:05.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:05.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:05.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:06.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:06.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:06.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:06.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:07.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:07.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:07.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:07.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:08.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:08.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:08.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:08.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:09.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:09.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:09.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:09.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:10.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:10.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:10.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:10.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:11.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:11.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:11.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:11.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:12.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:12.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:12.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:12.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:13.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:13.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:13.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:13.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:14.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:14.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:14.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:14.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:15.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:15.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:15.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:15.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:16.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:16.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:16.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:16.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:17.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:17.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:17.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:17.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:18.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:18.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:18.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:18.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:19.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:19.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:19.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:19.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:20.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:20.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:20.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:20.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:21.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:21.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:21.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:21.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:22.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:22.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:22.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:22.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:23.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:23.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:23.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:23.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:24.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:24.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:24.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:24.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:25.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:25.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:25.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:25.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:26.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:26.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:26.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:26.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:27.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:27.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:27.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:27.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:28.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:28.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:28.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:28.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:29.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:29.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:29.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:29.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:30.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:30.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:30.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:30.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:31.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:31.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:31.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:31.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:32.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:32.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:32.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:32.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:33.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:33.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:33.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:33.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:34.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:34.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:34.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:34.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:35.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:35.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:35.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:35.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:36.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:36.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:36.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:36.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:37.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:37.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:37.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:37.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:38.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:38.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:38.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:38.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:39.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:39.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:39.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:39.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:40.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:40.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:40.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:40.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:41.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:41.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:41.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:41.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:42.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:42.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:42.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:42.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:43.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:43.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:43.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:43.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:44.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:44.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:44.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:44.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:45.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:45.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:45.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:45.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:46.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:46.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:46.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:46.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:47.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:47.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:47.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:47.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:48.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:48.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:48.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:48.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:49.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:49.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:49.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:49.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:50.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:50.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:50.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:50.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:51.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:51.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:51.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:51.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:52.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:52.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:52.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:52.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:53.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:53.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:53.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:53.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:54.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:54.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:54.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:54.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:55.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:55.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:55.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:55.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:56.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:56.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:56.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:56.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:57.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:57.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:57.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:57.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:58.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:58.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:58.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:58.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:59.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:20:59.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:20:59.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:20:59.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:00.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:00.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:00.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:00.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:01.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:01.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:01.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:01.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:02.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:02.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:02.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:02.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:03.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:03.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:03.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:03.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:04.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:04.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:04.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:04.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:05.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:05.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:05.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:05.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:06.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:06.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:06.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:06.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:07.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:07.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:07.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:07.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:08.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:08.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:08.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:08.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:09.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:09.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:09.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:09.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:10.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:10.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:10.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:10.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:11.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:11.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:11.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:11.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:12.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:12.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:12.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:12.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:13.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:13.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:13.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:13.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:14.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:14.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:14.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:14.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:15.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:15.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:15.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:15.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:16.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:16.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:16.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:16.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:17.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:17.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:17.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:17.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:18.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:18.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:18.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:18.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:19.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:19.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:19.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:19.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:20.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:20.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:20.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:20.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:21.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:21.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:21.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:21.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:22.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:22.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:22.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:22.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:23.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:23.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:23.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:23.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:24.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:24.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:24.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:24.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:25.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:25.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:25.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:25.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:26.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:26.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:26.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:26.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:27.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:27.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:27.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:27.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:28.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:28.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:28.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:28.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:29.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:29.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:29.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:29.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:30.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:30.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:30.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:30.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:31.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:31.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:31.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:31.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:32.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:32.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:32.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:32.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:33.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:33.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:33.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:33.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:34.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:34.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:34.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:34.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:35.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:35.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:35.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:35.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:36.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:36.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:36.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:36.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:37.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:37.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:37.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:37.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:38.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:38.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:38.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:38.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:39.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:39.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:39.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:39.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:40.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:40.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:40.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:40.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:41.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:41.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:41.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:41.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:42.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:42.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:42.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:42.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:43.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:43.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:43.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:43.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:44.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:44.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:44.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:44.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:45.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:45.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:45.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:45.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:46.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:46.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:46.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:46.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:47.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:47.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:47.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:47.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:48.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:48.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:48.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:48.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:49.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:49.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:49.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:49.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:50.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:50.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:50.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:50.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:51.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:51.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:51.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:51.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:52.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:52.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:52.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:52.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:53.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:53.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:53.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:53.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:54.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:54.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:54.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:54.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:55.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:55.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:55.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:55.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:56.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:56.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:56.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:56.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:57.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:57.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:57.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:57.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:58.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:58.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:58.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:21:58.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:21:59.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:21:59.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:00.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:00.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:00.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:00.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:01.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:01.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:01.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:01.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:02.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:02.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:02.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:02.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:03.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:03.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:03.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:03.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:04.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:04.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:04.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:04.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:05.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:05.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:05.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:05.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:05.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:06.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:06.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:06.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:06.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:06.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:07.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:07.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:07.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:08.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:08.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:08.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:08.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:09.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:09.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:09.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:09.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:09.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:10.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:10.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:10.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:10.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:11.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:11.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:11.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:11.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:12.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:12.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:12.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:12.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:13.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:13.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:14.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:14.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:14.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:14.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:15.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:15.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:15.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:15.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:16.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:16.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:16.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:16.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:16.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:16.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:17.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:17.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:18.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:18.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:18.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:18.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:19.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:19.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:19.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:19.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:19.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:19.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:20.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:20.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:20.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:20.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:21.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:21.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:21.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:21.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:22.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:22.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:22.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:22.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:23.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:23.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:23.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:23.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:24.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:24.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:24.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:24.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:25.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:25.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:25.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:25.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:26.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:26.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:26.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:26.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:27.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:27.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:27.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:27.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:28.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:28.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:28.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:28.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:29.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:29.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:29.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:29.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:30.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:30.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:30.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:30.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:31.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:31.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:31.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:31.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:32.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:32.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:32.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:32.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:33.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:33.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:33.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:33.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:34.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:34.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:34.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:34.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:35.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:35.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:35.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:35.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:36.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:36.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:36.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:36.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:37.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:37.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:37.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:37.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:38.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:38.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:38.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:38.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:39.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:39.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:39.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:39.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:40.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:40.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:40.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:40.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:41.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:41.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:41.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:41.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:42.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:42.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:42.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:42.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:43.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:43.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:43.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:43.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:44.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:44.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:44.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:44.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:45.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:45.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:45.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:45.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:46.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:46.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:46.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:47.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:47.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:47.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:47.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:47.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:48.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:48.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:48.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:48.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:49.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:49.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:49.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:49.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:50.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:50.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:50.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:50.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:51.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:51.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:51.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:51.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:52.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:52.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:52.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:52.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:53.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:53.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:53.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:53.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:54.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:54.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:54.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:54.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:55.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:55.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:55.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:55.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:56.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:56.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:56.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:56.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:57.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:57.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:57.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:57.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:58.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:58.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:58.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:58.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:59.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:22:59.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:22:59.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:22:59.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:00.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:00.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:00.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:00.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:01.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:01.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:01.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:01.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:02.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:02.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:02.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:02.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:03.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:03.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:03.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:03.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:04.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:04.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:04.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:04.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:05.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:05.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:05.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:05.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:06.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:06.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:06.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:06.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:07.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:07.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:07.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:07.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:08.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:08.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:08.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:08.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:09.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:09.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:09.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:09.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:10.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:10.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:10.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:10.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:11.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:11.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:11.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:11.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:12.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:12.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:12.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:12.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:13.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:13.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:13.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:13.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:14.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:14.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:14.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:14.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:15.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:15.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:15.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:15.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:16.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:16.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:16.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:16.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:17.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:17.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:17.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:17.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:18.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:18.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:18.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:18.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:19.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:19.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:19.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:19.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:20.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:20.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:20.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:20.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:21.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:21.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:21.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:21.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:22.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:22.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:22.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:22.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:23.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:23.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:23.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:23.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:24.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:24.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:24.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:24.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:25.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:25.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:25.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:25.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:26.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:26.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:26.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:26.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:27.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:27.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:27.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:27.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:28.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:28.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:28.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:28.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:29.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:29.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:29.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:29.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:30.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:30.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:30.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:30.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:31.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:31.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:31.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:31.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:32.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:32.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:32.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:32.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:33.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:33.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:33.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:33.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:34.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:34.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:34.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:34.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:35.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:35.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:35.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:35.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:36.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:36.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:36.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:36.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:37.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:37.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:37.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:37.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:38.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:38.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:38.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:38.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:39.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:39.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:39.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:39.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:40.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:40.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:40.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:40.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:41.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:41.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:41.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:41.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:42.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:42.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:42.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:42.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:43.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:43.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:43.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:43.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:44.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:44.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:44.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:44.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:45.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:45.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:45.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:45.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:46.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:46.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:46.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:46.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:47.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:47.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:47.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:47.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:48.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:48.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:48.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:48.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:49.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:49.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:49.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:49.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:50.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:50.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:50.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:50.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:51.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:51.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:51.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:51.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:52.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:52.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:52.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:52.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:53.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:53.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:53.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:53.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:54.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:54.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:54.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:54.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:55.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:55.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:55.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:55.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:56.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:56.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:56.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:56.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:57.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:57.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:57.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:57.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:58.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:58.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:58.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:58.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:59.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:23:59.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:23:59.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:23:59.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:00.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:00.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:00.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:00.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:01.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:01.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:01.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:01.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:02.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:02.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:02.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:02.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:03.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:03.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:03.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:03.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:04.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:04.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:04.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:04.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:05.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:05.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:05.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:05.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:06.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:06.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:06.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:06.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:07.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:07.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:07.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:07.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:08.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:08.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:08.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:08.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:09.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:09.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:09.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:09.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:10.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:10.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:10.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:10.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:11.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:11.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:11.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:11.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:12.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:12.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:12.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:12.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:13.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:13.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:13.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:13.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:14.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:14.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:14.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:14.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:15.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:15.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:15.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:15.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:16.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:16.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:16.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:16.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:17.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:17.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:17.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:17.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:18.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:18.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:18.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:18.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:19.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:19.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:19.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:19.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:20.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:20.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:20.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:20.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:21.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:21.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:21.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:21.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:22.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:22.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:22.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:22.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:23.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:23.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:23.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:23.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:24.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:24.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:24.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:24.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:25.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:25.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:25.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:25.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:26.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:26.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:26.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:26.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:27.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:27.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:27.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:27.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:28.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:28.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:28.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:28.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:29.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:29.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:29.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:29.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:30.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:30.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:30.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:30.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:31.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:31.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:31.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:31.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:32.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:32.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:32.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:32.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:33.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:33.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:33.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:33.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:34.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:34.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:34.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:34.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:35.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:35.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:35.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:35.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:36.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:36.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:36.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:36.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:37.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:37.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:37.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:37.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:38.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:38.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:38.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:38.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:39.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:39.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:39.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:39.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:40.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:40.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:40.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:40.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:41.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:41.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:41.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:41.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:42.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:42.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:42.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:42.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:43.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:43.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:44.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:44.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:44.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:44.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:45.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:45.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:45.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:45.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:46.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:46.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:46.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:46.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:46.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:47.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:47.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:47.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:48.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:48.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:48.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:48.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:49.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:49.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:49.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:49.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:50.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:50.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:50.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:50.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:51.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:51.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:51.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:51.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:51.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:51.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:52.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:52.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:52.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:52.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:53.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:53.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:53.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:53.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:54.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:54.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:55.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:55.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:55.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:55.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:56.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:56.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:56.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:56.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:56.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:57.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:57.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:57.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:58.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:58.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:58.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:58.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:59.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:24:59.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:24:59.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:24:59.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:00.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:00.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:00.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:00.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:01.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:01.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:01.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:01.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:02.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:02.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:02.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:02.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:03.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:03.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:03.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:03.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:04.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:04.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:04.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:04.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:05.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:05.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:05.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:05.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:06.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:06.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:06.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:06.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:07.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:07.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:07.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:07.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:08.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:08.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:08.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:08.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:09.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:09.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:09.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:09.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:10.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:10.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:10.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:10.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:11.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:11.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:11.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:11.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:12.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:12.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:12.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:12.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:13.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:13.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:13.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:13.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:14.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:14.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:14.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:14.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:15.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:15.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:15.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:15.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:16.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:16.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:16.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:16.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:17.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:17.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:17.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:17.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:18.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:18.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:18.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:18.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:19.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:19.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:19.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:19.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:19.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:19.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:20.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:20.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:20.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:20.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:21.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:21.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:21.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:21.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:22.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:22.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:22.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:22.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:23.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:23.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:23.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:23.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:24.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:24.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:24.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:24.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:25.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:25.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:25.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:25.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:26.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:26.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:26.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:26.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:27.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:27.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:27.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:27.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:28.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:28.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:28.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:28.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:29.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:29.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:29.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:29.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:30.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:30.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:30.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:30.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:31.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:31.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:31.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:31.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:32.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:32.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:32.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:32.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:33.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:33.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:33.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:33.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:34.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:34.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:34.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:34.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:35.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:35.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:35.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:35.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:36.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:36.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:36.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:36.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:37.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:37.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:37.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:37.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:38.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:38.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:38.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:38.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:39.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:39.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:39.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:39.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:40.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:40.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:40.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:40.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:41.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:41.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:41.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:41.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:42.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:42.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:42.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:42.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:43.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:43.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:43.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:43.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:44.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:44.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:44.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:44.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:45.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:45.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:45.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:45.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:46.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:46.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:46.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:46.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:47.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:47.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:47.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:47.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:48.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:48.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:48.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:48.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:49.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:49.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:49.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:49.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:50.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:50.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:50.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:50.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:51.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:51.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:51.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:51.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:52.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:52.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:52.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:52.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:53.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:53.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:53.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:53.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:54.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:54.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:54.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:54.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:55.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:55.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:55.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:55.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:56.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:56.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:56.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:56.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:57.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:57.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:57.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:57.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:58.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:58.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:58.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:58.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:59.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:25:59.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:25:59.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:25:59.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:00.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:00.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:00.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:00.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:01.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:01.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:01.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:01.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:02.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:02.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:02.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:02.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:03.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:03.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:03.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:03.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:04.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:04.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:04.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:04.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:05.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:05.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:05.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:05.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:06.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:06.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:06.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:06.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:07.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:07.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:07.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:07.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:08.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:08.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:08.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:08.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:09.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:09.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:09.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:09.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:10.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:10.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:10.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:10.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:11.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:11.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:11.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:11.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:12.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:12.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:12.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:12.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:13.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:13.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:13.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:13.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:14.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:14.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:14.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:14.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:15.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:15.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:15.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:15.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:16.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:16.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:16.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:16.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:17.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:17.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:17.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:17.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:18.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:18.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:18.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:18.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:19.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:19.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:19.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:19.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:20.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:20.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:20.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:20.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:21.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:21.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:21.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:21.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:22.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:22.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:22.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:22.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:23.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:23.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:23.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:23.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:24.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:24.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:24.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:24.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:25.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:25.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:25.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:25.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:26.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:26.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:26.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:26.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:27.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:27.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:27.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:27.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:28.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:28.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:28.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:28.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:29.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:29.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:29.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:29.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:30.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:30.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:30.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:30.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:31.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:31.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:31.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:31.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:32.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:32.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:32.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:32.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:33.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:33.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:33.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:33.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:34.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:34.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:34.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:34.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:35.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:35.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:35.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:35.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:36.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:36.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:36.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:36.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:37.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:37.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:37.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:37.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:38.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:38.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:38.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:38.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:39.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:39.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:39.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:39.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:40.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:40.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:40.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:40.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:41.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:41.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:41.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:41.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:42.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:42.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:42.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:42.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:43.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:43.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:43.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:43.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:44.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:44.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:44.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:44.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:45.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:45.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:45.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:45.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:46.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:46.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:46.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:46.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:47.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:47.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:47.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:47.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:48.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:48.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:48.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:48.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:49.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:49.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:49.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:49.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:50.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:50.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:50.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:50.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:51.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:51.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:51.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:51.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:52.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:52.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:52.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:52.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:53.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:53.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:53.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:53.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:54.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:54.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:54.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:54.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:55.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:55.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:55.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:55.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:56.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:56.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:56.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:56.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:57.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:57.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:57.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:57.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:58.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:58.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:58.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:58.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:59.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:26:59.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:26:59.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:26:59.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:00.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:00.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:00.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:00.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:01.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:01.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:01.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:01.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:02.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:02.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:02.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:02.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:03.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:03.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:03.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:03.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:04.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:04.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:04.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:04.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:05.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:05.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:05.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:05.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:06.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:06.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:06.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:06.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:07.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:07.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:07.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:07.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:08.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:08.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:08.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:08.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:09.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:09.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:09.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:09.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:10.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:10.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:10.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:10.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:11.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:11.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:11.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:11.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:12.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:12.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:12.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:12.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:13.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:13.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:13.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:13.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:14.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:14.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:14.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:14.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:15.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:15.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:15.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:15.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:16.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:16.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:16.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:16.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:17.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:17.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:17.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:17.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:18.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:18.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:18.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:18.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:19.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:19.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:19.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:19.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:20.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:20.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:20.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:20.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:21.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:21.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:21.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:21.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:22.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:22.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:22.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:22.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:23.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:23.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:23.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:23.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:24.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:24.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:24.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:24.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:25.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:25.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:25.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:25.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:26.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:26.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:26.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:26.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:27.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:27.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:27.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:27.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:28.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:28.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:28.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:28.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:29.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:29.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:29.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:29.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:30.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:30.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:30.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:30.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:31.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:31.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:31.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:31.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:32.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:32.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:32.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:32.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:33.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:33.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:33.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:33.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:34.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:34.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:34.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:34.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:35.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:35.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:35.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:35.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:36.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:36.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:36.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:36.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:37.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:37.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:37.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:37.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:38.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:38.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:38.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:38.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:39.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:39.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:39.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:39.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:40.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:40.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:40.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:40.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:41.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:41.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:41.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:41.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:42.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:42.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:42.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:42.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:43.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:43.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:43.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:43.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:44.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:44.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:44.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:44.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:45.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:45.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:45.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:45.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:46.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:46.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:46.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:46.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:47.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:47.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:47.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:47.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:48.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:48.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:48.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:48.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:49.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:49.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:49.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:49.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:50.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:50.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:50.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:50.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:51.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:51.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:51.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:51.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:52.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:52.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:52.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:52.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:53.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:53.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:53.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:53.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:54.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:54.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:54.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:54.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:55.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:55.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:55.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:55.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:56.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:56.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:56.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:56.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:57.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:57.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:57.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:57.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:58.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:58.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:58.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:58.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:59.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:27:59.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:27:59.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:27:59.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:00.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:00.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:00.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:00.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:01.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:01.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:01.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:01.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:02.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:02.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:02.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:02.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:03.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:03.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:03.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:03.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:04.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:04.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:04.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:04.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:05.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:05.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:05.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:05.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:06.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:06.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:06.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:06.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:07.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:07.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:07.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:07.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:08.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:08.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:08.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:08.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:09.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:09.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:09.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:09.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:10.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:10.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:10.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:10.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:11.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:11.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:11.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:11.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:12.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:12.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:12.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:12.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:13.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:13.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:13.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:13.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:14.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:14.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:14.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:14.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:15.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:15.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:15.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:15.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:16.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:16.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:16.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:16.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:17.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:17.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:17.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:17.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:18.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:18.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:18.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:18.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:19.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:19.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:19.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:19.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:20.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:20.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:20.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:20.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:21.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:21.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:21.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:21.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:22.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:22.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:22.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:22.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:23.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:23.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:23.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:23.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:24.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:24.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:24.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:24.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:25.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:25.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:25.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:25.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:26.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:26.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:26.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:26.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:27.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:27.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:27.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:27.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:28.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:28.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:28.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:28.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:29.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:29.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:29.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:29.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:30.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:30.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:30.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:30.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:31.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:31.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:31.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:31.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:32.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:32.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:32.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:32.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:33.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:33.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:33.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:33.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:34.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:34.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:34.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:34.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:35.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:35.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:35.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:35.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:36.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:36.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:36.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:36.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:37.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:37.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:37.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:37.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:38.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:38.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:38.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:38.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:39.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:39.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:39.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:39.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:40.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:40.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:40.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:40.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:41.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:41.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:41.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:41.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:42.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:42.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:42.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:42.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:43.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:43.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:43.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:43.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:44.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:44.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:44.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:44.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:45.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:45.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:45.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:45.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:46.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:46.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:46.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:46.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:47.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:47.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:47.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:47.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:48.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:48.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:48.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:48.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:49.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:49.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:49.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:49.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:50.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:50.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:50.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:50.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:51.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:51.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:51.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:51.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:52.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:52.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:52.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:52.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:53.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:53.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:53.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:53.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:54.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:54.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:54.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:54.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:55.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:55.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:55.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:55.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:56.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:56.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:56.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:56.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:57.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:57.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:57.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:57.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:58.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:58.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:58.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:58.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:59.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:28:59.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:28:59.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:28:59.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:00.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:00.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:00.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:00.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:01.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:01.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:01.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:01.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:02.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:02.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:02.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:02.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:03.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:03.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:03.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:03.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:04.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:04.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:04.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:04.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:05.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:05.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:05.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:05.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:06.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:06.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:06.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:06.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:07.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:07.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:07.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:07.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:08.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:08.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:08.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:08.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:09.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:09.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:09.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:09.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:10.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:10.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:10.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:10.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:11.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:11.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:11.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:11.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:12.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:12.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:12.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:12.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:13.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:13.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:13.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:13.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:14.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:14.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:14.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:14.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:15.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:15.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:15.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:15.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:16.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:16.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:16.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:16.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:17.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:17.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:17.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:17.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:18.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:18.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:18.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:18.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:19.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:19.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:19.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:19.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:20.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:20.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:20.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:20.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:21.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:21.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:21.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:21.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:22.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:22.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:22.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:22.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:23.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:23.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:23.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:23.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:24.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:24.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:24.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:24.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:25.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:25.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:25.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:25.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:26.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:26.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:26.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:26.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:27.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:27.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:27.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:27.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:28.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:28.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:28.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:28.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:29.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:29.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:29.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:29.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:30.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:30.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:30.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:30.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:31.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:31.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:31.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:31.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:32.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:32.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:32.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:32.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:33.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:33.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:33.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:33.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:34.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:34.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:34.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:34.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:35.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:35.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:35.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:35.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 78 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:36.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:36.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:36.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:36.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:37.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:37.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:37.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:37.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:38.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:38.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:38.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:38.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:39.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:39.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:39.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:39.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:40.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:40.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:40.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:40.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:41.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:41.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:41.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:41.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:42.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:42.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:42.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:42.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:43.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:43.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:43.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:43.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:44.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:44.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:44.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:44.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:45.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:45.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:45.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:45.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:46.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:46.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:46.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:46.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:47.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:47.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:47.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:47.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:48.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:48.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:48.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:48.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:49.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:49.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:49.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:49.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:50.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:50.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:50.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:50.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:51.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:51.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:51.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:51.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:52.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:52.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:52.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:52.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:53.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:53.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:53.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:53.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:54.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:54.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:54.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:54.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:55.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:55.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:55.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:55.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:56.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:56.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:56.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:56.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:57.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:57.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:57.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:57.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:58.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:58.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:58.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:58.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:59.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:29:59.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:29:59.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:29:59.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:00.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:00.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:00.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:00.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:01.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:01.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:01.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:01.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:02.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:02.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:02.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:02.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:03.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:03.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:03.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:03.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:04.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:04.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:04.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:04.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:05.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:05.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:05.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:05.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 52 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:06.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:06.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:06.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:06.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:07.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:07.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:07.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:07.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:08.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:08.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:08.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:08.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:09.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:09.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:09.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:09.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:10.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:10.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:10.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:10.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:11.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:11.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:11.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:11.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:12.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:12.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:12.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:12.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:13.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:13.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:13.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:13.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:14.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:14.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:14.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:14.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:15.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:15.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:15.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:15.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:16.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:16.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:16.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:16.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:17.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:17.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:17.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:17.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:18.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:18.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:18.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:18.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:19.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:19.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:19.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:19.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:20.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:20.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:20.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:20.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:21.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:21.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:21.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:21.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:22.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:22.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:22.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:22.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:23.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:23.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:23.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:23.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:24.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:24.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:24.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:24.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:25.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:25.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:25.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:25.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:26.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:26.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:26.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:26.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:27.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:27.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:27.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:27.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:28.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:28.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:28.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:28.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:29.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:29.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:29.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:29.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:30.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:30.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:30.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:30.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:31.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:31.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:31.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:31.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:32.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:32.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:32.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:32.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:33.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:33.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:33.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:33.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:34.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:34.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:34.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:34.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:35.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:35.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:35.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:35.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:36.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:36.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:36.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:36.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:36.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:37.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:37.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:37.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:37.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:37.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:38.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:38.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:38.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:38.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:39.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:39.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:39.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:39.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:40.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:40.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:40.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:40.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:41.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:41.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:41.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:42.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:42.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:42.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:42.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:43.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:43.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:43.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:43.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:43.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:44.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:44.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:44.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:45.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:45.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:45.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:46.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:46.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:46.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:46.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:47.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:47.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:47.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:47.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:48.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:48.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:48.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:48.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:49.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:49.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:49.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:49.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:49.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:50.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:50.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:50.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:50.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:50.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:51.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:51.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:51.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:51.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:52.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:52.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:52.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:52.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:53.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:53.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:53.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:53.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:54.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:54.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:54.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:55.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:55.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:55.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:56.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:56.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:56.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:56.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:57.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:57.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:57.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:57.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:58.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:58.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:58.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:58.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:59.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:30:59.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:30:59.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:30:59.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:00.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:00.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:00.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:00.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:00.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:00.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:01.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:01.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:01.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:02.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:02.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:02.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:03.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:03.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:03.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:03.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:04.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:04.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:04.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:04.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:05.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:05.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:05.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:05.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:05.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:05.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:06.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:06.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:06.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:07.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:07.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:07.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:08.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:08.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:08.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:08.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:09.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:09.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:09.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:09.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:10.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:10.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:10.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:10.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:11.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:11.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:11.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:11.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:12.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:12.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:12.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:12.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:12.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:13.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:13.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:13.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:14.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:14.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:14.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:14.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:15.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:15.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:15.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:15.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:15.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:16.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:16.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:16.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:16.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:17.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:17.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:17.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:18.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:18.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:18.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:18.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:18.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:19.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:19.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:19.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:20.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:20.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:20.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:20.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:20.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:20.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:21.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:21.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:21.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:21.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:22.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:22.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:22.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:22.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:23.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:23.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:23.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:23.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:24.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:24.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:24.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:24.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:25.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:25.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:25.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:25.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:26.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:26.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:26.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:26.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:27.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:27.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:27.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:27.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:28.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:28.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:29.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:29.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:29.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:29.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:30.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:30.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:30.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:30.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:30.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:31.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:32.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:32.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:32.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:32.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:32.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:32.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:33.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:33.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:33.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:33.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:34.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:34.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:34.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:35.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:35.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:35.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:36.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:36.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:36.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:36.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:36.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:36.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:37.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:37.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:37.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:37.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:38.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:38.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:38.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:38.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:38.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:39.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:39.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:39.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:39.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:40.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:40.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:40.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:40.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:40.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:41.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:41.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:41.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:41.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:42.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:42.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:42.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:42.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:43.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:43.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:43.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:43.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:44.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:44.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:44.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:44.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:45.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:45.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:45.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:45.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:46.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:46.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:46.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:46.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:47.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:47.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:47.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:47.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:48.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:48.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:48.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:48.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:49.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:49.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:49.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:49.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:50.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:50.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:50.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:50.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:51.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:51.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:51.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:51.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:52.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:52.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:52.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:52.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:53.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:53.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:54.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:54.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:54.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:54.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:55.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:55.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:55.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:55.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:56.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:56.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:56.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:56.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:57.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:57.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:57.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:57.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:58.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:58.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:58.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:58.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:59.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:31:59.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:31:59.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:31:59.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:00.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:00.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:00.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:00.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:01.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:01.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:01.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:01.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:02.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:02.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:02.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:02.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:03.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:03.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:03.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:03.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:04.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:04.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:04.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:04.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:05.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:05.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:05.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:05.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:06.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:06.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:06.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:06.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:07.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:07.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:07.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:07.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:08.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:08.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:08.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:08.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:09.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:09.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:09.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:09.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:10.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:10.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:10.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:10.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:11.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:11.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:11.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:11.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:12.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:12.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:12.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:12.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:13.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:13.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:13.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:13.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:14.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:14.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:14.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:14.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:15.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:15.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:15.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:15.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:16.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:16.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:16.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:16.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:17.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:17.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:17.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:17.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:18.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:18.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:18.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:18.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:19.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:19.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:19.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:19.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:20.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:20.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:20.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:20.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:21.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:21.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:21.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:21.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:22.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:22.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:22.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:22.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:23.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:23.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:23.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:23.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:24.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:24.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:24.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:24.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:25.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:25.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:25.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:25.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:26.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:26.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:26.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:26.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:27.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:27.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:27.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:27.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:28.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:28.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:28.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:28.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:29.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:29.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:29.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:29.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:30.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:30.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:30.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:30.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:31.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:31.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:31.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:31.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:32.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:32.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:32.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:32.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:33.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:33.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:33.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:33.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:34.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:34.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:34.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:34.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:35.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:35.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:35.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:35.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:36.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:36.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:36.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:36.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:37.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:37.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:37.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:37.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:38.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:38.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:38.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:38.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:39.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:39.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:39.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:39.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:40.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:40.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:40.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:40.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:41.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:41.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:41.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:41.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:42.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:42.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:42.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:42.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:43.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:43.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:43.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:43.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:44.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:44.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:44.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:44.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:45.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:45.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:45.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:45.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:46.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:46.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:46.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:46.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:47.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:47.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:47.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:47.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:48.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:48.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:48.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:48.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:49.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:49.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:49.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:49.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:50.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:50.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:50.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:50.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:51.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:51.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:51.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:51.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:52.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:52.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:52.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:52.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:53.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:53.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:53.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:53.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:54.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:54.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:54.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:54.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:55.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:55.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:55.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:55.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:56.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:56.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:56.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:56.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:57.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:57.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:57.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:57.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:58.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:58.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:58.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:58.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:59.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:32:59.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:32:59.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:32:59.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:00.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:00.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:00.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:00.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:01.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:01.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:01.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:01.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:02.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:02.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:02.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:02.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:03.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:03.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:03.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:03.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:04.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:04.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:04.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:04.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:05.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:05.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:05.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:05.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:06.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:06.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:06.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:06.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:07.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:07.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:07.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:07.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:08.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:08.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:08.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:08.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:09.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:09.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:09.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:09.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:10.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:10.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:10.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:10.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:11.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:11.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:11.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:11.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:12.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:12.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:12.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:12.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:13.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:13.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:13.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:13.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:14.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:14.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:14.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:14.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:15.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:15.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:15.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:15.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:16.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:16.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:16.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:16.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:17.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:17.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:17.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:17.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:18.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:18.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:18.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:18.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:19.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:19.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:19.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:19.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:20.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:20.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:20.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:20.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:21.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:21.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:21.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:21.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:22.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:22.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:22.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:22.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:23.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:23.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:23.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:23.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:24.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:24.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:24.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:24.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:25.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:25.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:25.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:25.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:26.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:26.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:26.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:26.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:27.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:27.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:27.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:27.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:28.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:28.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:28.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:28.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:29.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:29.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:29.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:29.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:30.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:30.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:30.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:30.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:31.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:31.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:31.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:31.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:32.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:32.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:32.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:32.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:33.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:33.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:33.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:33.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:34.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:34.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:34.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:34.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:35.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:35.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:35.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:35.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:36.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:36.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:36.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:36.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:37.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:37.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:37.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:37.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:38.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:38.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:38.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:38.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:39.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:39.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:39.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:39.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:40.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:40.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:40.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:40.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:41.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:41.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:41.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:41.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:42.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:42.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:42.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:42.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:43.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:43.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:43.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:43.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:44.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:44.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:44.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:44.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:45.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:45.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:45.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:45.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:46.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:46.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:46.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:46.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:47.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:47.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:47.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:47.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:48.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:48.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:48.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:48.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:49.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:49.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:49.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:49.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:50.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:50.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:50.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:50.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:51.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:51.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:51.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:51.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:52.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:52.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:52.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:52.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:53.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:53.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:53.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:53.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:54.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:54.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:54.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:54.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:55.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:55.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:55.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:55.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:56.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:56.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:56.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:56.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:57.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:57.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:57.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:57.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:58.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:58.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:58.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:58.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:59.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:33:59.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:33:59.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:33:59.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:00.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:00.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:00.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:00.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:01.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:01.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:01.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:01.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:02.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:02.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:02.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:02.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:03.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:03.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:03.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:03.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:04.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:04.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:04.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:04.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:05.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:05.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:05.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:05.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:06.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:06.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:06.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:06.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:07.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:07.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:07.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:07.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:08.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:08.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:08.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:08.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:09.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:09.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:09.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:09.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:10.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:10.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:10.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:10.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:11.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:11.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:11.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:11.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:12.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:12.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:12.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:12.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:13.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:13.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:13.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:13.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:14.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:14.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:14.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:14.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:15.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:15.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:15.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:15.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:16.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:16.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:16.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:16.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:17.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:17.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:17.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:17.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:18.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:18.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:18.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:18.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:19.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:19.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:19.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:19.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:20.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:20.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:20.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:20.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:21.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:21.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:21.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:21.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:22.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:22.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:22.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:22.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:23.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:23.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:23.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:24.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:24.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:24.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:24.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:24.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:25.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:25.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:25.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:25.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:26.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:26.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:26.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:26.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:27.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:27.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:27.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:27.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:28.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:28.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:28.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:28.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:29.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:29.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:29.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:29.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:30.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:30.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:30.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:30.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:31.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:31.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:31.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:31.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:32.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:32.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:32.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:32.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:33.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:33.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:33.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:33.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:34.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:34.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:34.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:34.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:35.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:35.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:35.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:35.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:36.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:36.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:36.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:36.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:37.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:37.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:37.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:37.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:38.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:38.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:38.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:38.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:39.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:39.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:39.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:39.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:40.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:40.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:40.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:40.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:41.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:41.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:41.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:41.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:42.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:42.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:42.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:42.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:43.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:43.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:43.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:43.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:44.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:44.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:44.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:44.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:45.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:45.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:45.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:45.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:46.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:46.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:46.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:46.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:47.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:47.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:47.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:47.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:48.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:48.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:48.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:48.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:49.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:49.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:49.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:49.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:50.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:50.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:50.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:50.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:51.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:51.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:51.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:51.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:52.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:52.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:52.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:52.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:53.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:53.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:53.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:53.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:54.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:54.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:54.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:54.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:55.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:55.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:55.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:56.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:56.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:56.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:57.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:57.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:57.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:57.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:58.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:58.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:58.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:58.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:59.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:34:59.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:34:59.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:34:59.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:00.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:00.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:00.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:00.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:01.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:01.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:01.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:01.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:02.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:02.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:02.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:02.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:03.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:03.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:03.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:03.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:04.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:04.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:04.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:04.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:05.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:05.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:05.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:05.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:06.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:06.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:06.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:06.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:07.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:07.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:07.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:07.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:08.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:08.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:08.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:08.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:09.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:09.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:09.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:09.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:10.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:10.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:10.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:10.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:11.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:11.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:11.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:11.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:12.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:12.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:12.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:12.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:13.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:13.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:13.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:13.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:14.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:14.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:14.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:14.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:15.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:15.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:15.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:15.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:16.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:16.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:16.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:16.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:17.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:17.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:17.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:17.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:18.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:18.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:18.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:18.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:19.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:19.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:19.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:19.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:20.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:20.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:20.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:20.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:21.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:21.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:21.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:21.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:22.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:22.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:22.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:22.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:23.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:23.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:23.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:23.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:24.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:24.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:24.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:24.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:25.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:25.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:25.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:25.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:26.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:26.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:26.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:26.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:27.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:27.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:27.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:27.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:28.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:28.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:28.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:28.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:29.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:29.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:29.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:29.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:30.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:30.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:30.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:30.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:31.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:31.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:31.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:31.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:32.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:32.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:32.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:32.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:33.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:33.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:33.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:33.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:34.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:34.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:34.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:34.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:35.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:35.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:35.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:35.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:36.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:36.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:36.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:36.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:37.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:37.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:37.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:37.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:38.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:38.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:38.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:38.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:39.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:39.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:39.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:39.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:40.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:40.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:40.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:40.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:41.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:41.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:41.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:41.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:42.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:42.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:42.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:42.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:43.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:43.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:43.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:43.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:44.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:44.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:44.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:44.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:45.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:45.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:45.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:45.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:46.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:46.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:46.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:46.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:47.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:47.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:47.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:47.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:48.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:48.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:48.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:48.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:49.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:49.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:49.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:49.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:50.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:50.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:50.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:50.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:51.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:51.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:51.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:51.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:52.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:52.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:52.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:52.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:53.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:53.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:53.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:53.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:54.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:54.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:54.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:54.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:55.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:55.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:55.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:55.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:56.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:56.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:56.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:56.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:57.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:57.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:57.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:57.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:58.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:58.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:58.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:58.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:59.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:35:59.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:35:59.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:35:59.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:00.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:00.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:00.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:00.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:01.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:01.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:01.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:01.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:02.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:02.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:02.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:02.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:03.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:03.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:03.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:03.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:04.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:04.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:04.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:04.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:05.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:05.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:05.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:05.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:06.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:06.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:06.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:06.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:07.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:07.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:07.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:07.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:08.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:08.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:08.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:08.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:09.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:09.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:09.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:09.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:10.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:10.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:10.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:10.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:11.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:11.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:11.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:11.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:12.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:12.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:12.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:12.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:13.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:13.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:13.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:13.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:14.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:14.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:14.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:14.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:15.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:15.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:15.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:15.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:16.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:16.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:16.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:16.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:17.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:17.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:17.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:17.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:18.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:18.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:18.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:18.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:19.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:19.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:19.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:19.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:20.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:20.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:20.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:20.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:21.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:21.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:21.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:21.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:22.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:22.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:22.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:22.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:23.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:23.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:23.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:23.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:24.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:24.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:24.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:24.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:25.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:25.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:25.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:25.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:26.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:26.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:26.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:26.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:27.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:27.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:27.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:27.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:28.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:28.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:28.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:28.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:29.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:29.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:29.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:29.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:30.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:30.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:30.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:30.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:31.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:31.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:31.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:31.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:32.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:32.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:32.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:32.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:33.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:33.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:33.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:33.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:34.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:34.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:34.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:34.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:35.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:35.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:35.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:35.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:36.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:36.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:36.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:36.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:37.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:37.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:37.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:37.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:38.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:38.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:38.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:38.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:39.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:39.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:39.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:39.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:40.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:40.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:40.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:40.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:41.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:41.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:41.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:41.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:42.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:42.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:42.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:42.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:43.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:43.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:43.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:43.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:44.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:44.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:44.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:44.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:45.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:45.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:45.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:45.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:46.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:46.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:46.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:46.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:47.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:47.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:47.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:47.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:48.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:48.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:48.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:48.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:49.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:49.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:49.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:49.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:50.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:50.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:50.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:50.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:51.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:51.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:51.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:51.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:52.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:52.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:52.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:52.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:53.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:53.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:53.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:53.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:54.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:54.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:54.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:54.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:55.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:55.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:55.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:55.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:56.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:56.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:56.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:56.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:57.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:57.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:57.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:57.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:58.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:58.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:58.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:58.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:59.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:36:59.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:36:59.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:36:59.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:00.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:00.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:00.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:00.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:01.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:01.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:01.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:01.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:02.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:02.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:02.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:02.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:03.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:03.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:03.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:03.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:04.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:04.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:04.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:04.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:05.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:05.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:05.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:05.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:06.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:06.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:06.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:06.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:07.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:07.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:07.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:07.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:08.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:08.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:08.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:08.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:09.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:09.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:09.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:09.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:10.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:10.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:10.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:10.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:11.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:11.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:11.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:11.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:12.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:12.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:12.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:12.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:13.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:13.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:13.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:13.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:14.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:14.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:14.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:14.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:15.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:15.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:15.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:15.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:16.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:16.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:16.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:16.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:17.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:17.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:17.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:17.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:18.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:18.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:18.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:18.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:19.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:19.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:19.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:19.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:20.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:20.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:20.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:20.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:21.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:21.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:21.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:21.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:22.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:22.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:22.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:22.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:23.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:23.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:23.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:23.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:24.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:24.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:24.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:24.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:25.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:25.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:25.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:25.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:26.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:26.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:26.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:26.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:27.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:27.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:27.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:27.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:28.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:28.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:28.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:28.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:29.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:29.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:29.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:29.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:30.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:30.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:30.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:30.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:31.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:31.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:31.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:31.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:32.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:32.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:32.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:32.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:33.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:33.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:33.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:33.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:34.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:34.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:34.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:34.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:35.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:35.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:35.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:35.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:36.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:36.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:36.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:36.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:37.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:37.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:37.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:37.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:38.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:38.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:38.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:38.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:39.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:39.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:39.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:39.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:40.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:40.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:40.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:40.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:41.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:41.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:41.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:41.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:42.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:42.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:42.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:42.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:43.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:43.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:43.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:43.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:44.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:44.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:44.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:44.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:45.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:45.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:45.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:45.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:46.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:46.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:46.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:46.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:47.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:47.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:47.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:47.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:48.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:48.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:48.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:48.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:49.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:49.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:49.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:49.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:50.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:50.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:50.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:50.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:51.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:51.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:51.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:51.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:52.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:52.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:52.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:52.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:53.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:53.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:53.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:53.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:54.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:54.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:54.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:54.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:55.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:55.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:55.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:55.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:56.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:56.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:56.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:56.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:57.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:57.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:57.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:57.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:58.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:58.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:58.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:58.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:59.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:37:59.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:37:59.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:37:59.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:00.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:00.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:00.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:00.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:01.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:01.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:01.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:01.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:02.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:02.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:02.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:02.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:03.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:03.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:03.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:03.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:04.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:04.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:04.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:04.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:05.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:05.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:05.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:05.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:06.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:06.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:06.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:06.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:07.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:07.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:07.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:07.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:08.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:08.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:08.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:08.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:09.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:09.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:09.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:09.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:10.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:10.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:10.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:10.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:11.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:11.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:11.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:11.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:12.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:12.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:12.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:12.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:13.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:13.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:13.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:13.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:14.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:14.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:14.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:14.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:15.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:15.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:15.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:15.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:16.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:16.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:16.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:16.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:17.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:17.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:17.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:17.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:18.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:18.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:18.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:18.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:19.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:19.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:19.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:19.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:20.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:20.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:20.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:20.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:21.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:21.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:21.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:21.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:22.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:22.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:22.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:22.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:23.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:23.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:23.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:23.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:24.600 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T21:38:24.624+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac14ca60 msgr2=0x7f81ac053db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T21:38:24.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:24.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:24.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:24.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:25.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:25.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:25.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:25.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:26.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:26.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:26.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:26.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:27.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:27.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:27.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:27.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:28.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:28.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:28.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:28.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:29.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:29.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:29.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:29.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:30.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:30.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:30.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:30.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:31.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:31.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:31.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:31.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:32.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:32.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:32.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:32.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:33.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:33.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:33.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:33.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:34.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:34.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:34.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:34.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:35.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:35.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:35.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:35.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:36.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:36.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:36.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:36.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:37.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:37.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:37.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:37.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:38.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:38.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:38.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:38.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:39.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:39.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:39.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:39.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:40.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:40.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:40.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:40.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:41.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:41.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:41.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:41.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:42.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:42.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:42.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:42.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:43.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:43.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:43.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:43.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:44.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:44.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:44.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:44.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:45.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:45.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:45.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:45.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:46.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:46.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:46.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:46.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:47.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:47.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:47.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:47.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:48.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:48.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:48.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:48.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:49.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:49.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:49.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:49.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:50.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:50.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:50.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:50.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:51.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:51.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:51.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:51.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:52.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:52.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:52.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:52.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:53.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:53.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:53.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:53.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:54.607 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T21:38:54.629+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac03be80 msgr2=0x7f81ac040dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T21:38:54.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:54.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:54.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:54.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:55.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:55.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:55.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:55.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:56.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:56.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:56.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:56.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:57.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:57.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:57.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:57.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:58.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:58.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:58.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:58.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:59.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:38:59.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:38:59.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:38:59.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:00.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:00.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:00.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:00.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:01.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:01.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:01.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:01.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:02.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:02.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:02.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:02.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:03.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:03.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:03.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:03.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:04.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:04.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:04.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:04.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:05.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:05.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:05.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:05.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:06.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:06.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:06.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:06.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:07.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:07.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:07.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:07.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:08.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:08.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:08.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:08.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:09.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:09.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:09.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:09.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:10.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:10.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:10.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:10.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:11.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:11.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:11.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:11.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:12.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:12.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:12.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:12.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:13.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:13.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:13.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:13.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:14.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:14.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:14.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:14.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:15.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:15.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:15.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:15.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:16.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:16.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:16.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:16.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:17.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:17.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:17.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:17.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:18.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:18.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:18.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:18.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:19.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:19.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:19.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:19.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:20.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:20.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:20.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:20.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:21.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:21.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:21.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:21.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:22.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:22.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:22.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:22.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:23.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:23.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:23.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:23.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:24.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:24.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:24.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:24.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:25.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:25.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:25.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:25.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:26.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:26.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:26.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:26.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:27.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:27.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:27.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:27.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:28.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:28.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:28.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:28.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:29.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:29.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:29.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:29.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:30.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:30.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:30.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:30.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:31.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:31.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:31.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:31.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:32.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:32.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:32.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:32.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:33.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:33.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:33.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:33.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:34.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:34.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:34.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:34.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:35.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:35.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:35.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:35.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:36.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:36.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:36.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:36.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:37.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:37.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:37.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:37.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:38.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:38.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:38.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:38.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:39.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:39.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:39.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:39.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:40.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:40.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:40.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:40.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:41.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:41.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:41.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:41.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:42.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:42.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:42.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:42.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:43.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:43.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:43.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:43.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:44.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:44.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:44.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:44.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:45.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:45.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:45.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:45.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:46.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:46.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:46.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:46.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:47.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:47.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:47.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:47.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:48.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:48.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:48.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:48.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:49.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:49.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:49.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:49.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:50.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:50.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:50.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:50.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:51.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:51.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:51.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:51.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:52.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:52.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:52.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:52.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:53.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:53.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:53.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:53.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:54.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:54.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:54.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:54.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:55.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:55.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:55.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:55.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:56.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:56.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:56.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:56.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:57.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:57.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:57.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:57.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:58.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:58.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:58.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:58.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:59.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:39:59.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:39:59.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:39:59.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:00.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:00.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:00.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:00.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:01.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:01.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:01.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:01.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:02.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:02.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:02.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:02.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:03.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:03.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:03.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:03.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:04.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:04.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:04.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:04.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:05.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:05.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:05.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:05.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:06.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:06.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:06.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:06.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:07.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:07.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:07.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:07.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:08.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:08.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:08.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:08.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:09.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:09.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:09.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:09.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:10.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:10.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:10.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:10.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:11.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:11.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:11.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:11.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:12.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:12.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:12.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:12.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:13.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:13.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:14.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:14.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:14.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:14.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:14.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:14.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:15.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:15.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:15.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:15.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:16.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:16.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:16.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:16.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:17.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:17.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:17.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:17.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:18.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:18.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:18.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:18.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:19.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:19.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:19.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:19.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:20.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:20.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:20.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:20.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:21.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:21.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:21.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:21.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:22.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:22.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:22.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:22.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:23.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:23.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:23.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:23.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:24.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:24.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:24.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:24.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:25.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:25.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:25.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:25.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:26.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:26.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:26.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:26.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:27.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:27.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:27.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:27.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:28.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:28.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:28.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:28.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:29.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:29.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:29.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:29.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:30.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:30.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:30.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:30.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:31.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:31.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:31.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:31.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:32.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:32.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:32.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:32.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:33.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:33.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:33.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:33.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:34.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:34.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:34.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:34.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:35.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:35.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:35.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:35.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:36.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:36.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:36.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:36.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:37.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:37.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:37.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:37.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:38.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:38.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:38.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:38.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:39.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:39.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:39.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:39.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:40.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:40.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:40.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:40.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:41.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:41.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:41.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:41.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:42.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:42.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:42.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:42.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:43.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:43.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:43.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:43.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:44.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:44.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:44.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:44.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:45.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:45.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:45.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:45.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:46.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:46.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:46.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:46.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:47.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:47.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:47.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:47.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:48.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:48.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:48.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:48.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:49.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:49.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:49.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:49.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:50.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:50.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:50.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:50.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:51.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:51.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:51.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:51.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:52.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:52.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:52.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:52.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:53.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:53.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:53.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:53.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:54.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:54.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:54.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:54.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:55.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:55.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:55.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:55.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:56.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:56.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:56.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:56.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:57.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:57.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:57.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:57.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:58.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:58.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:58.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:58.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:59.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:40:59.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:40:59.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:40:59.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:00.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:00.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:00.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:00.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:01.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:01.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:01.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:01.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:02.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:02.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:02.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:02.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:03.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:03.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:03.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:03.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:04.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:04.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:04.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:04.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:05.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:05.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:05.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:05.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:06.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:06.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:06.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:06.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:07.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:07.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:07.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:07.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:08.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:08.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:08.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:08.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:09.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:09.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:09.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:09.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:10.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:10.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:10.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:10.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:11.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:11.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:11.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:11.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:12.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:12.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:12.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:12.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:13.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:13.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:13.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:13.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:14.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:14.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:14.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:14.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:15.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:15.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:15.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:15.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:16.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:16.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:16.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:16.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:17.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:17.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:17.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:17.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:18.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:18.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:18.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:18.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:19.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:19.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:19.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:19.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:20.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:20.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:20.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:20.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:21.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:21.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:21.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:21.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:22.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:22.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:22.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:22.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:23.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:23.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:23.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:23.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:24.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:24.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:24.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:24.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:25.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:25.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:25.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:25.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:26.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:26.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:27.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:27.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:27.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:27.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:28.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:28.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:28.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:28.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:29.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:29.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:29.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:29.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:30.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:30.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:30.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:30.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:31.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:31.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:31.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:31.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:32.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:32.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:32.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:32.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:33.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:33.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:33.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:33.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:34.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:34.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:34.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:34.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:35.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:35.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:35.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:35.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:36.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:36.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:36.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:36.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:37.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:37.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:37.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:37.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:38.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:38.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:38.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:38.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:39.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:39.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:39.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:39.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:40.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:40.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:40.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:40.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:41.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:41.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:41.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:41.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:42.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:42.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:42.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:42.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:43.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:43.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:43.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:43.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:44.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:44.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:44.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:44.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:45.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:45.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:45.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:45.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:46.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:46.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:46.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:46.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:47.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:47.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:47.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:47.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:48.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:48.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:48.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:48.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:49.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:49.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:49.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:49.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:50.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:50.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:50.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:50.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:51.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:51.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:51.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:51.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:52.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:52.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:52.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:52.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:53.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:53.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:53.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:53.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:54.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:54.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:54.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:54.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:55.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:55.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:55.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:55.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:56.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:56.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:56.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:56.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:57.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:57.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:57.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:57.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:58.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:58.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:58.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:58.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:59.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:41:59.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:41:59.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:41:59.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:00.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:00.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:00.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:00.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:01.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:01.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:01.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:01.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:02.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:02.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:02.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:02.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:03.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:03.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:03.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:03.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:04.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:04.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:04.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:04.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:05.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:05.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:05.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:05.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:06.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:06.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:06.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:06.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:07.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:07.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:07.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:07.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:08.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:08.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:08.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:08.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:09.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:09.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:09.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:09.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:10.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:10.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:10.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:10.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:11.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:11.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:11.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:11.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:12.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:12.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:12.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:12.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:13.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:13.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:13.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:13.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:14.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:14.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:14.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:14.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:15.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:15.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:15.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:15.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:16.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:16.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:16.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:16.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:17.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:17.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:17.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:17.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:18.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:18.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:18.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:18.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:19.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:19.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:19.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:19.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:20.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:20.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:20.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:20.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:21.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:21.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:21.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:21.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:22.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:22.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:22.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:22.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:23.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:23.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:23.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:23.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:24.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:24.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:24.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:24.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:25.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:25.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:25.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:25.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:26.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:26.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:26.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:26.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:27.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:27.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:27.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:27.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:28.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:28.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:28.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:28.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:29.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:29.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:29.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:29.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:30.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:30.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:30.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:30.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:31.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:31.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:31.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:31.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:32.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:32.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:32.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:32.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:33.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:33.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:33.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:33.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:34.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:34.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:34.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:34.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:35.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:35.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:35.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:35.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:36.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:36.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:36.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:36.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:36.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:36.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:37.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:37.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:37.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:37.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:38.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:38.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:38.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:39.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:39.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:39.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:39.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:39.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:40.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:40.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:40.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:40.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:41.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:41.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:41.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:41.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:42.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:42.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:43.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:43.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:43.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:43.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:44.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:44.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:44.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:44.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:45.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:45.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:45.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:45.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:46.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:46.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:46.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:46.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:47.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:47.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:47.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:47.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:48.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:48.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:48.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:48.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:49.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:49.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:49.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:49.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:50.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:50.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:50.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:50.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:51.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:51.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:51.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:51.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:52.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:52.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:52.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:52.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:53.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:53.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:53.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:53.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:54.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:54.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:54.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:54.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:55.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:55.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:55.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:55.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:56.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:56.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:56.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:56.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:57.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:57.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:57.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:57.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:58.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:58.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:58.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:58.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:59.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:42:59.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:42:59.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:42:59.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:00.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:00.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:00.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:00.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:00.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:00.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:01.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:01.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:01.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:02.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:02.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:02.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:02.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:02.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:03.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:03.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:03.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:04.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:04.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:04.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:05.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:05.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:05.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:05.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:06.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:06.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:06.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:06.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:07.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:07.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:07.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:07.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:08.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:08.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:08.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:08.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:08.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:08.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:09.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:09.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:09.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:09.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:10.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:10.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:10.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:10.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:11.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:11.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:11.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:11.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:12.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:12.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:12.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:12.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:13.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:13.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:13.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:13.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:14.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:14.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:14.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:14.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:15.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:15.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:15.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:15.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:16.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:16.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:16.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:16.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:17.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:17.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:17.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:17.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:18.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:18.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:18.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:18.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:19.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:19.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:19.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:19.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:20.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:20.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:20.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:20.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:21.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:21.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:21.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:21.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:22.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:22.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:23.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:23.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:23.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:23.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:24.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:24.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:24.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:24.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:25.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:25.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:25.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:25.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:26.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:26.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:26.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:26.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:27.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:27.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:27.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:27.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:28.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:28.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:28.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:28.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:29.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:29.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:29.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:29.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:30.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:30.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:30.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:30.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:31.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:31.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:31.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:31.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:32.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:32.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:32.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:32.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:33.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:33.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:33.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:33.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:33.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:33.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:34.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:34.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:35.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:35.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:35.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:35.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:35.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:36.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:36.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:36.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:37.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:37.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:37.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:37.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:38.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:38.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:38.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:38.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:39.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:39.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:39.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:39.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:40.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:40.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:40.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:40.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:41.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:41.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:41.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:41.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:42.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:42.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:42.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:42.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:43.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:43.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:43.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:43.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:44.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:44.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:44.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:44.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:45.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:45.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:45.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:45.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:46.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:46.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:46.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:46.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:47.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:47.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:47.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:47.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:48.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:48.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:48.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:48.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:48.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:48.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:49.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:49.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:49.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:49.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:50.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:50.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:50.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:50.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:51.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:51.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:51.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:51.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:52.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:52.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:52.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:52.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:53.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:53.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:53.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:53.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:54.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:54.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:54.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:54.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:55.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:55.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:55.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:55.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:56.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:56.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:56.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:56.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:57.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:57.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:57.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:57.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:58.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:58.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:58.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:58.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:59.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:43:59.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:43:59.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:43:59.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:00.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:00.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:00.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:00.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:01.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:01.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:01.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:01.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:02.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:02.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:02.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:02.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:03.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:03.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:03.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:03.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:04.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:04.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:04.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:04.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:05.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:05.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:05.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:05.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:06.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:06.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:06.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:06.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:07.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:07.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:07.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:07.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:08.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:08.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:08.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:08.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:09.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:09.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:09.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:09.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:10.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:10.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:10.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:10.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:11.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:11.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:11.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:11.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:12.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:12.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:12.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:12.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:13.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:13.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:13.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:13.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:14.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:14.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:14.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:14.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:15.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:15.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:15.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:15.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:16.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:16.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:16.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:16.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:17.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:17.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:17.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:17.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:18.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:18.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:18.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:18.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:19.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:19.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:19.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:19.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:20.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:20.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:20.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:20.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:21.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:21.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:21.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:21.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:22.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:22.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:22.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:22.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:23.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:23.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:23.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:23.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:24.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:24.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:24.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:24.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:25.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:25.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:25.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:25.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:26.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:26.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:26.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:26.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:27.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:27.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:27.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:27.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:28.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:28.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:28.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:28.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:29.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:29.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:29.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:29.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:30.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:30.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:31.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:31.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:31.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:31.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:32.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:32.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:32.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:32.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:33.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:33.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:33.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:33.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:34.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:34.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:34.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:34.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:35.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:35.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:35.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:35.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 81 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:36.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:36.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:36.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:36.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:37.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:37.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:37.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:37.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:38.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:38.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:38.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:38.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:39.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:39.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:39.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:39.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:40.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:40.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:40.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:40.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:41.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:41.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:41.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:41.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:42.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:42.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:42.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:42.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:43.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:43.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:43.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:43.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:44.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:44.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:44.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:44.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:45.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:45.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:45.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:45.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:46.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:46.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:46.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:46.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:47.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:47.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:47.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:47.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:48.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:48.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:48.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:48.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:49.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:49.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:49.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:49.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:50.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:50.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:50.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:50.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:51.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:51.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:51.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:51.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:52.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:52.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:52.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:52.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:53.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:53.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:53.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:53.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:54.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:54.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:54.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:54.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:55.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:55.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:55.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:55.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:56.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:56.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:56.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:56.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:56.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:56.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:57.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:57.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:58.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:58.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:58.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:58.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:44:58.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:44:59.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:44:59.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:44:59.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:45:00.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:00.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:00.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:00.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:45:01.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:01.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:01.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:01.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:45:02.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:02.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:02.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:02.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:45:03.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:03.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:03.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:03.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:45:04.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:04.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:04.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:04.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:45:05.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:05.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:05.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:05.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 27 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T21:45:06.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:06.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:06.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:06.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:07.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:07.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:07.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:07.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:08.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:08.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:08.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:08.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:09.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:09.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:09.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:09.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:10.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:10.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:10.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:10.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:11.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:11.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:11.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:11.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:12.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:12.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:12.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:12.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:13.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:13.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:13.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:13.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:14.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:14.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:14.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:14.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:15.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:15.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:15.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:15.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:16.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:16.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:16.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:16.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:17.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:17.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:17.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:17.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:18.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:18.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:18.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:18.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:18.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:18.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:19.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:19.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:20.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:20.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:20.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:20.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:21.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:21.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:21.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:21.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:22.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:22.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:22.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:22.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:23.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:23.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:23.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:23.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:24.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:24.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:24.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:24.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:25.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:25.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:25.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:25.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:26.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:26.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:26.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:26.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:27.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:27.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:27.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:27.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:28.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:28.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:28.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:28.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:28.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:28.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:29.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:29.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:30.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:30.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:30.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:30.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:31.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:31.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:31.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:31.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:31.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:32.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:32.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:32.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:32.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:32.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:33.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:33.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:33.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:33.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:34.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:34.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:34.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:34.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:35.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:35.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:35.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:35.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:36.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:36.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:36.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:36.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:37.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:37.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:37.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:37.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:38.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:38.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:38.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:38.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:39.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:39.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:39.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:39.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:40.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:40.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:40.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:40.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:41.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:41.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:41.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:41.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:42.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:42.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:42.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:42.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:43.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:43.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:43.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:43.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:44.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:44.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:44.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:44.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:45.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:45.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:45.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:45.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:46.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:46.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:46.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:46.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:47.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:47.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:47.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:47.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:48.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:48.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:48.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:48.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:49.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:49.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:49.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:49.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:50.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:50.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:50.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:50.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:51.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:51.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:51.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:51.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:52.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:52.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:52.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:52.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:53.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:53.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:53.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:53.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:54.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:54.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:54.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:54.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:55.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:55.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:55.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:55.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:56.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:56.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:56.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:56.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:57.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:57.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:57.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:57.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:58.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:58.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:58.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:58.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:59.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:45:59.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:45:59.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:45:59.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:00.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:00.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:00.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:00.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:01.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:01.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:01.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:01.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:02.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:02.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:02.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:02.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:03.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:03.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:03.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:03.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:04.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:04.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:04.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:04.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:05.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:05.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:05.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:06.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:06.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:06.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:06.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:06.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:07.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:07.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:08.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:08.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:08.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:08.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:08.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:08.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:09.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:09.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:09.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:09.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:10.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:10.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:10.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:10.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:11.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:11.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:11.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:11.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:12.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:12.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:12.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:13.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:13.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:13.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:13.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:13.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:14.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:14.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:14.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:14.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:15.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:15.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:15.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:15.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:16.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:16.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:16.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:16.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:17.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:17.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:17.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:17.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:18.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:18.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:18.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:18.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:19.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:19.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:20.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:20.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:20.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:20.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:20.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:20.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:21.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:21.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:21.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:21.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:22.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:22.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:22.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:22.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:23.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:23.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:23.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:23.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:24.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:24.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:24.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:24.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:25.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:25.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:25.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:25.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:26.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:26.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:26.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:26.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:27.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:27.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:27.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:27.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:28.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:28.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:28.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:28.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:29.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:29.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:29.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:29.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:30.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:30.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:30.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:30.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:31.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:31.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:31.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:31.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:32.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:32.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:32.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:32.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:33.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:33.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:33.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:33.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:34.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:34.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:34.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:35.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:35.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:35.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:35.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:35.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:36.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:36.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:36.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:36.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:37.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:37.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:37.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:37.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:38.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:38.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:38.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:38.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:39.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:39.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:39.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:39.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:40.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:40.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:40.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:40.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:41.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:41.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:41.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:41.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:42.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:42.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:42.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:42.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:43.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:43.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:43.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:43.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:44.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:44.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:44.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:44.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:45.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:45.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:45.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:45.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:46.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:46.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:46.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:46.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:47.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:47.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:48.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:48.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:48.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:48.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:48.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:49.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:49.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:49.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:49.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:49.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:50.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:50.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:50.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:50.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:51.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:51.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:52.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:52.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:52.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:52.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:52.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:52.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:53.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:53.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:53.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:53.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:54.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:54.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:54.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:54.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:55.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:55.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:55.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:55.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:56.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:56.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:56.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:56.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:57.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:57.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:57.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:57.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:58.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:58.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:58.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:58.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:59.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:46:59.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:46:59.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:46:59.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:00.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:00.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:00.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:00.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:01.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:01.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:01.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:01.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:02.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:02.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:02.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:02.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:03.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:03.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:03.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:03.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:04.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:04.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:04.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:04.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:05.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:05.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:05.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:05.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:06.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:06.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:06.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:06.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:07.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:07.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:07.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:07.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:08.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:08.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:08.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:08.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:09.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:09.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:09.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:09.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:10.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:10.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:10.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:10.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:11.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:11.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:11.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:11.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:12.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:12.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:12.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:12.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:13.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:13.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:13.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:13.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:14.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:14.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:14.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:14.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:15.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:15.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:15.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:15.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:16.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:16.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:16.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:16.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:17.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:17.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:17.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:17.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:18.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:18.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:18.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:18.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:19.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:19.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:19.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:19.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:20.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:20.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:20.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:20.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:21.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:21.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:21.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:21.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:22.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:22.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:22.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:22.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:23.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:23.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:23.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:23.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:24.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:24.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:24.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:24.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:25.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:25.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:25.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:25.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:26.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:26.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:26.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:26.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:27.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:27.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:28.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:28.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:28.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:28.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:29.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:29.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:29.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:29.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:30.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:30.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:30.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:30.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:31.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:31.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:31.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:31.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:32.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:32.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:32.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:32.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:33.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:33.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:33.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:33.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:34.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:34.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:34.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:34.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:35.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:35.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:35.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:35.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:36.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:36.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:36.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:36.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:37.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:37.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:37.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:37.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:38.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:38.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:38.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:38.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:39.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:39.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:39.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:39.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:40.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:40.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:40.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:40.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:41.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:41.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:41.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:41.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:42.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:42.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:42.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:42.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:43.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:43.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:43.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:43.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:44.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:44.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:44.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:44.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:45.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:45.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:45.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:45.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:46.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:46.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:46.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:46.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:47.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:47.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:47.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:47.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:48.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:48.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:48.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:48.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:49.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:49.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:49.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:49.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:50.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:50.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:50.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:50.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:51.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:51.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:51.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:51.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:52.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:52.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:52.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:52.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:52.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:52.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:53.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:53.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:54.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:54.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:54.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:54.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:55.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:55.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:55.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:55.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:56.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:56.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:56.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:56.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:57.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:57.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:57.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:57.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:58.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:58.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:58.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:58.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:58.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:58.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:59.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:47:59.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:47:59.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:47:59.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:00.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:00.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:00.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:00.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:01.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:01.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:02.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:02.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:02.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:02.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:03.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:03.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:03.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:03.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:04.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:04.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:04.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:04.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:05.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:05.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:05.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:05.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:06.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:06.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:06.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:06.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:07.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:07.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:07.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:07.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:08.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:08.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:08.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:08.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:09.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:09.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:09.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:09.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:10.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:10.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:10.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:10.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:11.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:11.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:11.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:11.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:12.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:12.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:12.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:12.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:13.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:13.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:13.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:13.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:14.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:14.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:14.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:14.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:15.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:15.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:15.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:15.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:16.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:16.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:16.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:16.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:17.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:17.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:17.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:17.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:18.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:18.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:18.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:18.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:19.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:19.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:19.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:19.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:20.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:20.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:20.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:20.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:21.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:21.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:21.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:21.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:22.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:22.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:22.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:22.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:23.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:23.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:23.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:23.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:24.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:24.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:24.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:24.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:25.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:25.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:25.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:25.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:26.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:26.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:26.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:26.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:27.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:27.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:27.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:27.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:28.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:28.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:28.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:28.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:29.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:29.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:29.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:29.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:30.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:30.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:30.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:30.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:31.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:31.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:31.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:31.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:32.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:32.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:32.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:32.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:33.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:33.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:33.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:33.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:34.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:34.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:34.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:34.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:35.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:35.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:35.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:35.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:36.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:36.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:36.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:36.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:37.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:37.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:37.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:37.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:38.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:38.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:38.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:38.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:39.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:39.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:39.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:39.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:40.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:40.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:40.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:40.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:41.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:41.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:41.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:41.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:42.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:42.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:42.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:42.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:43.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:43.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:43.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:43.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:44.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:44.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:44.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:44.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:45.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:45.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:45.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:45.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:46.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:46.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:46.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:46.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:47.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:47.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:47.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:47.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:48.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:48.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:48.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:48.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:49.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:49.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:49.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:49.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:50.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:50.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:50.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:50.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:51.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:51.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:51.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:51.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:52.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:52.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:52.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:52.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:52.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:52.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:53.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:53.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:53.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:53.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:54.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:54.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:55.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:55.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:55.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:55.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:56.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:56.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:56.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:56.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:57.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:57.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:57.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:57.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:57.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:57.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:58.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:58.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:58.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:58.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:59.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:48:59.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:48:59.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:48:59.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:00.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:00.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:01.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:01.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:01.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:01.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:02.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:02.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:02.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:02.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:03.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:03.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:03.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:03.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:04.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:04.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:04.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:04.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:04.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:04.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:05.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:05.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:06.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:06.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:06.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:06.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:07.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:07.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:07.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:07.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:08.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:08.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:08.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:08.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:08.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:08.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:09.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:09.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:09.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:09.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:10.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:10.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:10.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:10.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:11.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:11.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:11.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:11.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:12.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:12.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:12.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:12.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:13.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:13.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:13.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:13.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:14.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:14.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:14.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:14.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:15.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:15.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:15.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:15.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:16.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:16.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:16.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:16.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:17.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:17.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:17.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:17.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:18.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:18.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:18.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:18.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:19.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:19.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:19.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:19.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:20.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:20.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:20.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:20.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:21.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:21.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:21.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:21.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:22.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:22.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:22.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:22.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:23.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:23.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:23.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:23.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:24.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:24.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:24.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:24.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:25.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:25.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:25.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:25.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:26.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:26.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:26.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:26.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:27.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:27.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:27.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:27.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:28.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:28.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:28.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:28.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:29.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:29.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:29.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:29.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:30.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:30.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:30.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:30.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:31.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:31.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:31.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:31.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:32.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:32.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:32.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:32.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:33.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:33.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:33.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:33.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:34.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:34.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:34.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:34.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:35.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:35.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:35.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:35.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:36.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:36.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:36.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:36.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:37.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:37.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:37.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:37.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:38.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:38.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:38.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:38.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:39.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:39.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:39.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:39.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:40.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:40.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:40.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:40.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:41.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:41.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:41.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:41.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:42.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:42.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:42.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:42.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:43.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:43.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:43.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:43.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:44.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:44.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:44.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:44.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:45.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:45.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:45.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:45.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:46.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:46.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:46.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:46.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:47.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:47.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:47.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:47.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:48.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:48.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:48.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:48.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:49.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:49.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:49.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:49.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:50.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:50.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:50.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:50.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:51.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:51.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:51.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:51.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:52.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:52.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:52.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:52.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:53.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:53.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:53.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:53.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:54.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:54.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:54.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:54.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:55.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:55.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:55.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:55.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:56.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:56.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:56.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:56.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:57.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:57.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:57.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:57.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:58.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:58.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:58.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:58.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:59.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:49:59.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:49:59.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:49:59.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:00.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:00.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:00.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:00.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:01.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:01.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:01.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:01.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:02.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:02.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:02.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:02.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:03.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:03.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:03.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:03.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:04.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:04.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:04.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:04.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:05.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:05.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:05.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:05.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:06.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:06.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:06.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:06.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:07.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:07.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:07.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:07.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:08.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:08.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:08.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:08.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:09.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:09.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:09.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:09.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:10.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:10.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:10.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:10.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:11.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:11.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:11.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:11.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:12.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:12.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:12.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:12.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:13.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:13.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:13.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:13.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:14.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:14.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:14.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:14.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:15.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:15.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:15.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:15.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:16.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:16.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:16.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:16.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:17.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:17.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:17.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:17.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:18.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:18.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:18.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:18.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:19.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:19.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:19.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:19.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:20.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:20.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:20.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:20.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:21.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:21.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:21.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:21.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:22.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:22.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:22.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:22.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:23.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:23.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:23.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:23.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:24.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:24.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:24.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:24.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:25.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:25.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:25.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:25.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:26.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:26.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:26.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:26.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:27.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:27.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:27.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:27.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:28.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:28.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:28.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:28.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:29.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:29.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:29.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:29.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:30.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:30.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:30.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:30.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:31.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:31.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:31.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:31.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:32.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:32.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:32.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:32.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:33.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:33.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:33.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:33.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:34.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:34.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:34.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:34.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:35.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:35.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:35.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:35.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:36.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:36.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:36.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:36.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:37.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:37.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:37.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:37.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:38.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:38.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:38.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:38.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:39.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:39.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:39.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:39.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:40.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:40.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:40.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:40.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:41.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:41.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:41.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:41.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:42.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:42.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:42.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:42.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:43.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:43.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:43.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:43.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:44.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:44.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:44.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:44.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:45.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:45.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:45.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:45.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:46.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:46.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:46.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:46.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:47.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:47.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:47.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:47.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:48.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:48.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:48.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:48.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:49.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:49.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:49.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:49.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:50.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:50.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:50.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:50.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:51.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:51.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:51.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:51.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:52.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:52.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:52.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:52.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:53.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:53.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:53.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:53.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:54.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:54.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:54.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:54.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:55.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:55.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:55.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:55.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:56.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:56.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:56.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:56.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:57.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:57.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:57.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:57.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:58.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:58.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:58.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:58.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:59.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:50:59.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:50:59.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:50:59.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:00.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:00.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:00.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:00.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:01.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:01.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:01.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:01.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:02.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:02.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:02.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:02.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:03.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:03.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:03.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:03.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:04.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:04.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:04.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:04.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:05.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:05.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:05.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:05.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:06.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:06.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:06.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:06.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:07.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:07.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:07.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:07.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:08.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:08.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:08.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:08.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:09.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:09.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:09.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:09.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:10.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:10.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:10.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:10.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:11.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:11.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:11.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:11.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:12.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:12.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:12.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:12.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:13.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:13.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:13.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:13.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:14.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:14.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:14.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:14.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:15.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:15.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:15.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:15.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:16.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:16.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:16.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:16.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:17.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:17.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:17.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:17.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:18.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:18.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:18.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:18.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:19.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:19.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:19.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:19.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:20.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:20.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:20.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:20.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:21.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:21.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:21.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:21.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:22.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:22.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:22.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:22.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:23.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:23.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:23.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:23.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:24.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:24.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:24.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:24.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:25.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:25.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:25.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:25.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:26.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:26.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:26.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:26.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:27.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:27.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:27.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:27.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:28.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:28.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:28.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:28.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:29.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:29.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:29.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:29.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:30.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:30.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:30.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:30.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:31.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:31.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:31.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:31.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:32.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:32.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:32.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:32.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:33.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:33.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:33.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:33.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:34.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:34.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:34.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:34.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:35.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:35.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:35.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:35.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:36.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:36.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:36.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:36.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:37.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:37.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:37.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:37.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:38.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:38.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:38.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:38.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:39.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:39.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:40.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:39.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:40.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:40.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:40.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:40.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:41.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:41.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:41.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:41.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:42.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:42.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:42.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:42.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:43.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:43.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:44.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:44.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:44.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:44.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:45.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:45.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:45.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:45.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:46.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:46.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:46.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:46.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:46.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:46.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:48.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:48.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:48.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:48.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:49.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:49.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:49.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:49.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:50.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:50.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:50.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:50.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:51.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:51.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:51.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:51.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:52.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:52.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:52.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:52.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:53.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:53.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:53.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:53.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:54.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:54.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:54.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:54.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:55.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:55.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:55.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:55.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:55.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:55.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:56.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:56.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:56.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:56.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:57.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:57.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:57.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:57.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:58.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:58.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:58.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:58.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:59.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:51:59.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:51:59.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:51:59.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:00.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:00.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:00.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:00.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:01.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:01.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:01.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:01.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:02.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:02.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:02.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:02.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:03.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:03.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:03.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:03.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:04.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:04.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:04.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:04.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:05.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:05.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:05.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:05.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:06.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:06.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:06.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:06.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:07.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:07.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:07.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:07.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:08.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:08.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:08.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:08.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:09.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:09.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:09.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:09.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:10.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:10.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:10.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:10.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:11.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:11.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:11.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:11.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:12.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:12.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:12.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:12.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:13.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:13.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:13.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:13.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:14.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:14.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:14.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:14.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:15.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:15.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:15.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:15.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:16.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:16.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:16.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:16.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:17.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:17.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:17.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:17.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:18.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:18.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:18.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:18.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:18.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:18.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:19.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:19.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:20.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:20.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:20.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:20.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:21.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:21.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:21.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:21.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:22.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:22.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:22.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:22.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:23.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:23.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:23.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:23.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:23.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:23.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:24.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:24.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:24.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:24.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:25.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:25.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:25.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:25.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:26.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:26.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:26.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:26.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:27.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:27.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:27.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:27.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:28.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:28.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:28.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:28.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:29.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:29.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:29.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:29.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:30.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:30.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:30.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:30.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:31.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:31.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:31.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:31.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:32.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:32.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:33.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:33.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:33.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:33.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:33.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:33.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:34.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:34.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:34.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:34.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:35.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:35.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:35.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:35.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:36.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:36.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:36.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:36.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:37.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:37.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:37.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:37.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:38.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:38.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:38.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:38.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:39.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:39.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:39.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:39.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:40.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:40.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:40.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:40.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:41.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:41.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:41.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:41.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:42.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:42.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:42.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:42.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:43.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:43.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:43.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:43.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:44.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:44.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:44.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:44.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:45.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:45.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:45.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:45.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:46.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:46.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:46.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:46.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:47.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:47.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:47.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:47.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:48.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:48.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:48.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:48.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:49.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:49.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:49.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:49.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:50.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:50.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:50.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:50.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:51.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:51.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:51.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:51.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:52.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:52.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:52.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:52.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:53.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:53.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:53.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:53.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:54.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:54.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:54.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:54.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:55.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:55.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:55.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:55.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:56.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:56.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:56.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:56.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:57.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:57.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:57.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:57.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:58.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:58.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:58.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:58.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:59.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:52:59.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:52:59.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:52:59.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:00.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:00.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:00.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:00.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:01.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:01.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:01.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:01.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:02.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:02.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:02.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:02.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:03.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:03.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:03.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:03.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:04.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:04.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:04.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:04.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:05.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:05.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:05.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:05.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:06.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:06.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:06.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:06.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:07.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:07.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:07.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:07.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:08.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:08.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:08.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:08.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:09.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:09.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:09.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:09.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:10.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:10.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:10.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:10.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:11.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:11.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:11.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:11.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:12.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:12.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:12.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:12.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:13.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:13.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:13.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:13.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:14.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:14.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:14.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:14.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:15.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:15.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:15.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:15.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:16.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:16.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:16.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:16.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:17.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:17.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:17.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:17.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:18.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:18.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:18.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:18.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:19.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:19.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:19.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:19.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:20.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:20.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:20.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:20.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:21.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:21.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:21.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:21.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:22.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:22.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:22.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:22.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:23.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:23.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:23.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:23.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:24.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:24.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:24.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:24.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:25.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:25.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:25.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:25.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:26.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:26.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:26.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:26.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:27.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:27.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:27.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:27.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:28.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:28.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:28.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:28.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:29.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:29.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:29.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:29.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:30.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:30.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:30.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:30.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:31.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:31.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:31.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:31.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:32.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:32.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:32.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:32.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:33.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:33.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:33.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:33.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:34.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:34.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:34.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:34.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:35.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:35.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:35.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:35.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:36.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:36.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:36.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:36.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:37.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:37.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:37.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:37.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:38.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:38.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:38.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:38.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:39.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:39.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:39.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:39.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:40.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:40.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:40.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:40.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:41.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:41.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:41.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:41.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:42.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:42.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:42.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:42.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:43.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:43.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:43.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:43.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:44.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:44.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:44.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:44.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:45.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:45.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:45.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:45.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:46.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:46.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:46.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:46.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:47.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:47.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:47.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:47.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:48.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:48.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:48.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:48.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:49.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:49.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:49.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:49.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:50.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:50.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:50.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:50.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:51.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:51.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:51.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:51.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:52.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:52.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:52.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:52.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:53.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:53.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:53.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:53.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:54.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:54.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:54.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:54.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:55.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:55.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:55.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:55.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:56.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:56.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:56.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:56.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:57.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:57.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:57.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:57.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:58.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:58.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:58.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:58.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:59.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:53:59.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:53:59.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:53:59.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:00.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:00.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:00.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:00.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:01.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:01.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:01.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:01.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:02.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:02.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:02.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:02.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:03.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:03.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:03.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:03.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:04.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:04.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:04.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:04.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:05.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:05.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:05.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:05.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:06.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:06.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:06.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:06.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:07.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:07.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:07.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:07.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:08.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:08.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:08.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:08.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:09.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:09.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:09.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:09.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:10.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:10.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:10.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:10.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:11.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:11.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:11.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:11.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:12.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:12.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:12.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:12.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:13.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:13.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:13.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:13.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:14.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:14.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:14.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:14.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:15.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:15.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:15.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:15.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:16.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:16.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:16.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:16.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:17.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:17.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:17.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:17.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:18.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:18.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:19.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:19.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:19.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:19.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:19.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:19.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:20.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:20.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:20.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:20.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:21.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:21.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:21.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:21.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:22.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:22.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:23.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:23.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:23.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:23.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:24.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:24.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:24.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:24.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:25.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:25.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:25.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:25.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:26.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:26.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:26.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:26.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:27.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:27.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:27.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:27.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:28.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:28.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:28.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:28.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:29.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:29.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:29.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:29.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:29.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:29.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:30.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:30.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:30.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:30.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:31.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:31.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:31.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:31.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:32.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:32.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:33.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:33.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:33.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:33.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:34.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:34.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:34.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:34.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:35.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:35.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:35.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:35.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:36.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:36.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:36.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:36.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:37.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:37.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:37.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:37.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:38.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:38.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:38.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:38.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:39.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:39.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:39.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:39.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:40.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:40.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:40.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:40.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:41.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:41.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:41.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:41.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:42.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:42.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:42.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:42.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:43.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:43.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:43.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:43.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:44.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:44.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:44.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:44.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:45.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:45.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:45.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:45.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:46.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:46.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:46.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:46.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:47.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:47.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:47.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:47.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:48.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:48.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:48.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:48.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:49.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:49.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:49.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:49.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:50.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:50.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:50.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:50.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:51.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:51.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:51.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:51.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:51.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:51.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:52.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:52.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:52.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:52.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:53.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:53.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:53.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:53.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:54.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:54.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:54.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:54.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:55.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:55.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:55.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:55.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:56.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:56.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:56.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:56.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:57.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:57.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:57.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:57.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:58.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:58.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:58.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:58.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:59.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:54:59.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:54:59.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:54:59.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:00.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:00.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:00.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:00.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:01.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:01.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:01.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:01.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:02.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:02.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:02.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:02.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:03.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:03.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:03.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:03.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:04.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:04.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:04.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:04.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:05.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:05.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:05.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:05.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:06.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:06.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:06.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:06.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:07.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:07.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:07.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:07.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:08.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:08.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:08.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:08.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:09.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:09.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:09.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:09.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:10.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:10.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:10.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:10.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:11.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:11.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:11.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:11.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:12.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:12.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:12.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:12.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:13.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:13.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:13.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:13.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:14.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:14.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:14.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:14.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:15.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:15.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:15.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:15.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:16.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:16.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:16.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:16.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:17.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:17.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:17.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:17.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:18.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:18.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:18.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:18.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:19.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:19.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:19.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:19.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:20.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:20.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:20.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:20.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:21.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:21.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:21.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:21.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:22.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:22.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:22.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:22.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:23.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:23.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:23.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:23.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:24.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:24.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:24.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:24.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:25.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:25.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:25.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:25.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:26.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:26.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:26.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:26.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:27.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:27.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:27.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:27.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:28.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:28.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:28.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:28.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:29.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:29.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:29.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:29.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:30.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:30.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:30.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:30.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:31.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:31.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:31.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:31.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:32.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:32.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:32.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:32.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:33.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:33.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:33.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:33.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:34.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:34.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:34.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:34.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:35.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:35.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:35.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:35.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:36.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:36.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:36.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:36.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:37.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:37.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:37.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:37.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:38.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:38.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:38.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:38.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:39.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:39.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:39.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:39.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:40.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:40.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:40.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:40.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:41.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:41.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:41.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:41.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:42.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:42.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:42.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:42.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:43.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:43.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:43.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:43.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:44.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:44.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:44.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:44.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:45.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:45.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:45.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:45.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:46.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:46.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:46.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:46.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:47.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:47.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:47.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:47.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:48.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:48.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:48.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:48.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:49.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:49.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:49.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:49.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:50.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:50.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:50.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:50.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:51.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:51.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:51.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:51.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:52.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:52.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:52.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:52.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:53.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:53.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:53.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:53.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:54.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:54.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:54.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:54.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:55.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:55.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:55.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:55.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:56.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:56.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:56.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:56.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:57.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:57.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:57.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:57.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:58.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:58.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:58.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:58.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:59.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:55:59.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:55:59.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:55:59.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:00.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:00.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:00.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:00.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:01.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:01.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:01.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:01.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:02.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:02.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:02.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:02.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:03.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:03.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:03.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:03.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:04.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:04.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:04.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:04.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:05.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:05.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:05.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:05.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:06.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:06.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:06.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:06.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:07.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:07.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:07.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:07.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:08.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:08.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:08.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:08.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:09.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:09.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:09.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:09.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:10.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:10.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:10.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:10.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:11.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:11.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:11.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:11.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:12.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:12.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:12.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:12.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:13.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:13.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:13.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:13.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:14.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:14.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:14.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:14.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:15.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:15.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:15.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:15.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:16.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:16.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:16.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:16.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:17.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:17.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:17.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:17.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:18.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:18.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:18.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:18.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:19.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:19.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:19.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:19.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:20.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:20.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:20.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:20.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:21.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:21.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:21.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:21.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:22.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:22.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:22.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:22.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:23.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:23.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:23.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:23.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:24.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:24.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:24.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:24.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:25.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:25.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:25.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:25.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:26.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:26.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:26.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:26.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:27.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:27.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:27.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:27.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:28.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:28.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:28.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:28.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:29.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:29.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:29.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:29.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:30.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:30.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:30.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:30.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:31.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:31.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:31.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:31.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:32.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:32.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:32.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:32.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:33.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:33.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:33.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:33.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:34.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:34.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:35.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:34.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:35.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:35.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:35.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:35.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:36.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:36.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:36.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:36.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:37.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:37.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:37.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:37.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:38.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:38.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:38.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:38.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:39.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:39.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:39.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:39.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:40.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:40.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:40.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:40.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:41.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:41.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:42.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:42.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:42.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:42.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:43.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:43.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:43.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:43.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:44.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:44.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:44.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:44.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:45.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:45.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:45.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:45.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:46.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:46.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:46.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:46.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:47.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:47.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:47.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:47.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:48.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:48.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:48.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:48.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:49.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:49.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:49.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:49.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:50.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:50.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:50.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:50.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:51.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:51.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:51.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:51.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:52.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:52.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:52.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:52.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:53.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:53.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:53.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:53.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:54.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:54.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:54.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:54.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:55.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:55.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:55.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:55.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:56.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:56.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:56.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:56.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:57.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:57.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:57.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:57.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:58.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:58.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:58.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:58.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:59.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:56:59.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:56:59.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:56:59.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:00.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:00.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:00.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:00.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:01.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:01.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:01.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:01.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:02.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:02.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:02.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:02.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:03.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:03.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:03.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:03.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:04.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:04.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:04.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:04.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:05.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:05.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:05.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:05.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:06.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:06.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:06.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:06.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:07.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:07.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:07.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:07.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:08.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:08.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:08.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:08.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:09.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:09.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:09.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:09.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:10.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:10.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:10.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:10.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:11.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:11.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:11.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:11.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:12.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:12.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:12.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:12.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:13.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:13.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:13.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:13.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:14.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:14.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:14.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:14.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:15.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:15.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:15.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:15.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:16.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:16.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:16.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:16.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:17.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:17.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:17.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:17.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:18.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:18.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:18.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:18.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:19.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:19.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:19.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:19.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:20.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:20.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:20.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:20.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:21.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:21.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:21.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:21.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:22.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:22.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:22.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:22.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:23.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:23.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:23.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:23.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:24.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:24.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:24.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:24.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:25.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:25.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:25.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:25.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:26.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:26.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:26.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:26.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:27.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:27.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:27.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:27.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:28.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:28.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:28.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:28.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:29.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:29.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:29.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:29.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:30.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:30.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:30.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:30.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:31.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:31.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:31.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:31.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:32.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:32.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:32.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:32.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:33.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:33.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:33.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:33.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:34.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:34.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:34.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:34.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:35.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:35.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:35.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:35.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:36.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:36.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:36.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:36.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:37.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:37.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:37.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:37.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:38.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:38.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:38.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:38.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:39.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:39.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:39.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:39.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:40.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:40.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:40.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:40.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:41.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:41.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:41.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:41.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:42.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:42.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:42.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:42.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:43.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:43.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:43.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:43.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:44.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:44.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:44.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:44.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:45.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:45.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:45.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:45.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:46.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:46.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:46.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:46.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:47.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:47.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:47.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:47.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:48.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:48.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:48.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:48.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:49.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:49.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:49.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:49.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:50.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:50.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:50.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:50.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:51.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:51.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:51.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:51.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:52.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:52.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:52.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:52.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:53.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:53.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:53.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:53.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:54.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:54.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:54.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:54.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:55.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:55.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:55.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:55.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:56.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:56.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:56.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:56.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:57.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:57.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:57.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:57.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:58.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:58.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:58.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:58.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:59.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:57:59.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:57:59.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:57:59.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:00.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:00.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:00.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:00.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:01.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:01.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:01.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:01.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:02.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:02.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:02.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:02.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:03.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:03.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:03.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:03.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:04.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:04.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:04.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:04.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:05.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:05.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:05.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:05.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:06.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:06.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:06.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:06.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:07.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:07.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:07.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:07.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:08.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:08.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:08.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:08.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:09.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:09.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:09.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:09.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:10.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:10.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:10.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:10.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:11.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:11.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:11.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:11.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:12.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:12.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:12.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:12.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:13.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:13.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:13.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:13.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:14.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:14.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:14.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:14.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:15.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:15.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:15.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:15.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:16.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:16.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:16.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:16.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:17.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:17.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:17.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:17.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:18.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:18.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:18.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:18.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:19.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:19.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:19.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:19.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:20.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:20.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:20.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:20.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:21.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:21.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:21.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:21.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:22.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:22.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:22.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:22.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:23.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:23.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:23.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:23.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:24.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:24.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:24.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:24.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:25.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:25.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:25.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:25.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:26.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:26.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:26.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:26.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:27.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:27.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:27.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:27.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:28.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:28.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:28.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:28.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:29.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:29.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:29.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:29.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:30.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:30.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:30.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:30.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:31.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:31.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:31.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:31.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:32.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:32.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:32.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:32.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:33.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:33.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:33.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:33.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:34.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:34.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:34.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:34.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:35.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:35.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:35.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:35.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:36.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:36.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:36.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:36.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:37.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:37.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:37.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:37.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:38.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:38.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:38.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:38.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:39.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:39.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:39.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:39.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:40.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:40.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:40.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:40.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:41.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:41.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:41.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:41.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:42.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:42.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:42.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:42.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:43.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:43.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:43.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:43.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:44.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:44.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:44.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:44.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:45.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:45.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:45.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:45.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:46.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:46.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:46.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:46.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:47.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:47.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:47.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:47.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:48.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:48.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:48.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:48.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:49.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:49.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:49.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:49.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:50.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:50.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:50.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:50.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:51.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:51.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:51.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:51.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:52.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:52.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:52.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:52.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:53.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:53.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:53.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:53.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:54.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:54.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:54.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:54.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:55.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:55.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:55.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:55.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:56.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:56.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:56.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:56.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:57.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:57.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:57.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:57.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:58.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:58.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:58.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:58.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:59.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:58:59.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:58:59.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:58:59.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:00.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:00.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:00.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:00.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:01.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:01.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:01.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:01.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:02.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:02.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:02.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:02.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:03.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:03.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:03.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:03.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:04.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:04.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:04.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:04.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:05.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:05.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:05.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:05.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:06.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:06.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:06.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:06.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:07.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:07.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:07.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:07.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:08.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:08.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:08.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:08.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:09.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:09.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:09.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:09.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:10.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:10.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:10.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:10.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:11.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:11.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:11.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:11.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:12.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:12.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:12.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:12.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:13.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:13.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:13.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:13.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:14.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:14.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:14.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:14.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:15.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:15.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:15.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:15.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:16.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:16.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:16.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:16.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:17.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:17.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:17.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:17.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:18.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:18.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:18.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:18.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:19.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:19.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:19.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:19.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:20.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:20.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:20.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:20.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:21.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:21.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:21.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:21.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:22.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:22.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:22.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:22.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:23.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:23.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:23.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:23.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:24.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:24.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:24.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:24.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:25.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:25.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:25.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:25.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:26.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:26.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:26.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:26.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:27.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:27.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:27.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:27.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:28.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:28.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:28.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:28.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:29.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:29.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:29.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:29.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:30.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:30.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:30.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:30.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:31.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:31.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:31.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:31.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:32.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:32.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:32.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:32.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:33.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:33.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:33.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:33.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:34.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:34.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:34.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:34.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:35.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:35.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 84 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:35.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:35.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:36.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:36.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:36.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:36.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:37.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:37.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:37.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:37.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:38.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:38.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:38.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:38.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:39.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:39.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:39.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:39.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:40.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:40.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:40.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:40.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:41.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:41.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:41.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:41.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:42.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:42.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:42.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:42.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:43.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:43.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:43.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:43.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:44.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:44.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:44.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:44.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:45.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:45.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:45.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:45.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:46.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:46.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:46.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:46.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:47.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:47.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:47.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:47.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:48.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:48.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:48.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:48.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:49.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:49.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:49.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:49.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:50.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:50.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:50.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:50.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:51.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:51.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:51.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:51.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:52.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:52.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:52.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:52.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:53.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:53.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:53.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:53.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:54.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:54.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:54.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:54.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:55.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:55.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:55.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:55.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:56.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:56.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:56.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:56.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:57.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:57.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:57.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:57.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:58.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:58.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:58.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:58.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:59.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T21:59:59.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T21:59:59.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T21:59:59.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:00.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:00.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:00.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:00.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:01.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:01.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:01.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:01.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:02.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:02.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:02.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:02.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:03.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:03.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:03.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:03.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:04.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:04.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:04.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:04.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:05.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:05.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 72 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:05.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:05.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:06.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:06.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:06.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:06.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:07.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:07.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:07.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:07.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:08.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:08.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:08.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:08.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:09.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:09.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:09.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:09.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:10.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:10.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:10.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:10.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:11.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:11.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:11.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:11.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:12.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:12.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:12.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:12.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:13.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:13.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:13.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:13.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:14.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:14.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:14.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:14.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:15.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:15.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:15.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:15.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:16.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:16.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:16.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:16.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:17.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:17.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:17.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:17.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:18.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:18.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:18.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:18.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:19.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:19.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:19.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:19.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:20.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:20.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:20.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:20.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:21.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:21.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:21.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:21.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:22.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:22.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:22.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:22.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:23.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:23.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:23.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:23.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:24.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:24.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:24.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:24.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:25.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:25.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:25.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:25.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:26.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:26.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:26.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:26.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:27.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:27.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:27.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:27.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:28.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:28.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:28.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:28.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:29.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:29.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:29.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:29.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:30.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:30.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:30.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:30.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:31.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:31.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:31.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:31.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:32.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:32.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:32.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:32.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:33.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:33.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:33.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:33.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:34.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:34.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:34.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:34.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:35.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:35.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:35.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:35.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:36.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:36.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:36.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:36.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:37.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:37.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:37.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:37.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:38.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:38.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:38.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:38.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:39.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:39.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:39.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:39.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:40.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:40.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:40.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:40.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:41.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:41.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:41.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:41.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:42.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:42.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:42.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:42.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:43.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:43.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:43.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:43.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:44.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:44.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:44.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:44.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:45.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:45.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:45.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:45.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:46.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:46.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:46.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:46.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:47.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:47.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:47.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:47.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:48.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:48.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:48.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:48.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:49.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:49.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:49.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:49.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:50.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:50.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:50.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:50.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:51.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:51.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:51.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:51.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:52.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:52.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:52.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:52.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:53.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:53.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:53.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:53.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:54.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:54.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:54.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:54.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:55.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:55.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:55.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:55.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:56.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:56.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:56.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:56.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:57.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:57.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:57.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:57.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:58.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:58.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:58.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:58.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:59.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:00:59.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:00:59.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:00:59.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:00.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:00.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:00.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:00.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:01.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:01.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:01.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:01.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:02.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:02.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:02.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:02.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:03.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:03.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:03.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:03.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:04.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:04.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:04.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:04.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:05.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:05.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:05.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:05.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:06.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:06.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:06.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:06.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:07.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:07.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:07.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:07.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:08.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:08.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:08.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:08.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:09.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:09.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:09.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:09.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:10.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:10.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:10.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:10.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:11.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:11.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:11.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:11.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:12.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:12.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:12.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:12.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:13.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:13.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:13.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:13.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:14.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:14.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:14.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:14.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:15.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:15.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:15.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:15.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:16.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:16.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:16.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:16.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:17.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:17.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:17.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:17.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:18.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:18.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:18.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:18.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:19.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:19.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:19.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:19.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:20.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:20.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:20.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:20.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:21.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:21.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:21.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:21.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:22.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:22.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:22.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:22.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:23.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:23.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:23.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:23.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:24.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:24.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:24.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:24.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:25.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:25.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:25.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:25.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:26.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:26.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:26.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:26.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:27.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:27.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:27.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:27.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:28.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:28.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:28.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:28.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:29.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:29.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:29.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:29.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:30.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:30.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:30.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:30.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:31.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:31.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:31.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:31.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:32.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:32.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:32.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:32.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:33.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:33.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:33.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:33.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:34.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:34.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:34.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:34.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:35.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:35.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:35.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:35.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:36.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:36.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:36.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:36.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:37.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:37.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:37.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:37.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:38.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:38.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:38.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:38.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:39.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:39.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:39.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:39.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:40.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:40.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:40.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:40.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:41.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:41.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:41.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:41.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:42.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:42.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:42.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:42.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:43.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:43.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:43.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:43.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:44.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:44.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:44.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:44.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:45.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:45.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:45.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:45.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:46.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:46.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:46.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:46.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:47.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:47.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:47.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:47.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:48.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:48.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:48.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:48.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:49.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:49.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:49.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:49.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:50.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:50.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:50.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:50.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:51.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:51.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:51.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:51.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:52.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:52.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:52.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:52.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:53.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:53.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:53.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:53.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:54.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:54.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:54.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:54.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:55.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:55.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:55.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:55.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:56.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:56.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:56.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:56.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:57.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:57.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:57.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:57.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:58.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:58.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:58.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:58.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:59.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:01:59.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:01:59.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:01:59.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:00.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:00.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:00.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:00.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:01.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:01.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:01.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:01.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:02.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:02.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:02.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:02.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:03.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:03.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:03.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:03.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:04.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:04.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:04.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:04.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:05.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:05.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:05.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:05.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:06.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:06.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:06.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:06.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:07.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:07.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:07.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:07.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:08.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:08.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:08.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:08.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:09.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:09.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:09.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:09.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:10.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:10.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:10.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:10.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:11.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:11.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:11.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:11.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:12.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:12.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:12.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:12.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:13.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:13.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:13.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:13.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:14.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:14.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:14.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:14.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:15.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:15.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:15.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:15.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:16.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:16.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:16.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:16.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:17.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:17.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:17.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:17.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:18.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:18.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:18.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:18.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:19.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:19.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:19.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:19.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:20.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:20.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:20.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:20.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:21.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:21.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:21.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:21.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:22.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:22.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:22.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:22.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:23.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:23.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:23.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:23.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:24.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:24.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:24.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:24.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:25.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:25.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:25.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:25.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:26.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:26.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:26.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:26.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:27.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:27.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:27.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:27.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:28.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:28.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:28.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:28.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:29.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:29.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:29.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:29.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:30.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:30.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:30.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:30.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:30.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:30.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:31.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:31.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:32.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:32.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:32.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:32.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:33.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:33.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:33.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:33.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:34.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:34.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:34.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:34.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:35.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:35.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:35.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:35.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:36.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:36.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:36.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:36.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:37.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:37.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:37.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:37.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:38.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:38.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:38.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:38.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:39.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:39.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:39.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:39.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:40.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:40.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:40.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:40.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:41.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:41.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:41.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:41.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:41.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:41.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:42.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:42.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:42.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:42.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:43.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:43.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:43.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:43.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:44.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:44.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:44.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:44.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:45.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:45.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:45.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:45.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:46.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:46.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:46.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:46.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:47.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:47.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:47.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:47.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:48.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:48.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:48.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:48.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:49.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:49.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:49.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:49.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:50.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:50.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:50.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:50.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:51.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:51.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:51.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:51.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:52.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:52.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:52.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:52.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:53.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:53.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:53.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:53.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:54.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:54.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:54.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:54.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:55.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:55.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:55.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:55.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:56.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:56.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:56.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:56.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:57.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:57.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:57.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:57.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:58.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:58.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:58.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:58.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:59.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:02:59.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:02:59.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:02:59.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:00.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:00.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:00.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:00.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:01.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:01.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:01.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:01.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:02.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:02.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:03.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:03.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:03.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:03.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:04.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:04.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:04.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:04.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:05.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:05.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:05.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:05.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:05.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:05.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:06.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:06.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:06.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:06.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:07.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:07.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:08.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:08.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:08.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:08.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:09.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:08.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:09.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:09.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:10.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:10.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:10.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:10.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:11.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:11.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:11.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:11.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:11.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:11.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:12.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:12.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:12.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:12.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:13.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:13.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:13.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:13.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:14.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:14.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:14.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:14.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:15.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:15.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:15.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:15.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:16.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:16.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:16.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:16.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:17.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:17.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:17.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:17.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:18.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:18.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:18.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:18.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:19.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:19.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:19.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:19.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:20.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:20.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:20.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:20.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:21.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:21.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:21.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:21.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:22.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:22.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:22.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:22.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:23.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:23.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:23.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:23.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:24.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:24.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:24.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:24.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:25.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:25.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:25.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:25.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:26.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:26.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:26.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:26.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:27.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:27.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:27.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:27.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:28.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:28.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:28.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:28.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:29.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:29.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:29.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:29.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:30.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:30.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:30.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:30.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:31.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:31.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:31.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:31.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:32.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:32.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:32.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:32.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:33.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:33.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:33.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:33.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:34.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:34.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:34.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:34.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:35.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:35.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:35.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:35.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:36.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:36.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:36.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:36.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:37.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:37.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:37.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:37.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:38.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:38.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:38.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:38.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:39.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:39.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:39.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:39.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:40.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:40.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:40.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:40.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:41.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:41.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:41.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:41.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:42.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:42.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:42.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:42.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:43.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:43.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:43.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:43.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:44.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:44.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:44.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:44.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:45.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:45.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:45.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:45.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:46.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:46.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:46.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:46.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:47.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:47.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:47.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:47.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:48.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:48.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:48.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:48.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:49.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:49.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:49.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:49.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:50.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:50.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:50.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:50.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:51.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:51.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:51.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:51.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:52.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:52.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:52.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:52.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:53.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:53.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:53.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:53.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:54.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:54.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:54.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:54.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:55.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:55.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:55.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:55.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:56.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:56.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:56.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:56.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:57.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:57.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:57.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:57.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:58.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:58.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:58.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:58.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:59.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:03:59.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:03:59.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:03:59.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:00.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:00.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:00.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:00.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:01.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:01.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:01.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:01.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:02.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:02.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:02.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:02.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:03.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:03.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:03.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:03.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:04.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:04.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:04.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:04.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:05.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:05.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:05.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:05.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:06.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:06.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:06.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:06.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:07.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:07.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:07.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:07.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:08.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:08.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:08.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:08.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:09.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:09.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:09.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:09.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:10.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:10.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:10.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:10.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:11.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:11.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:11.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:11.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:12.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:12.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:12.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:12.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:13.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:13.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:13.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:13.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:14.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:14.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:14.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:14.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:15.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:15.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:15.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:15.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:16.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:16.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:16.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:16.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:17.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:17.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:17.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:17.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:18.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:18.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:18.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:18.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:19.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:19.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:19.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:19.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:20.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:20.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:20.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:20.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:21.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:21.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:21.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:21.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:22.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:22.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:22.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:22.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:23.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:23.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:23.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:23.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:24.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:24.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:24.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:24.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:25.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:25.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:25.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:25.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:26.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:26.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:26.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:26.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:27.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:27.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:27.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:27.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:28.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:28.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:28.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:28.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:29.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:29.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:29.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:29.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:30.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:30.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:30.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:30.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:31.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:31.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:31.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:31.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:32.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:32.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:32.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:32.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:33.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:33.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:33.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:33.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:34.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:34.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:34.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:34.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:35.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:35.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:35.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:35.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:36.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:36.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:36.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:36.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:37.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:37.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:37.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:37.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:38.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:38.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:38.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:38.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:39.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:39.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:39.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:39.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:40.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:40.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:40.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:40.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:41.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:41.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:41.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:41.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:42.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:42.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:42.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:42.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:43.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:43.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:43.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:43.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:44.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:44.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:44.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:44.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:45.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:45.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:45.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:45.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:46.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:46.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:46.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:46.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:47.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:47.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:47.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:47.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:48.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:48.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:48.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:48.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:49.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:49.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:49.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:49.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:50.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:50.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:50.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:50.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:51.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:51.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:51.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:51.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:52.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:52.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:52.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:52.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:53.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:53.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:53.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:53.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:54.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:54.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:54.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:54.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:55.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:55.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:55.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:55.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:56.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:56.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:56.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:56.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:57.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:57.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:57.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:57.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:58.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:58.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:58.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:58.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:59.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:04:59.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:04:59.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:04:59.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:00.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:00.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:00.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:00.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:01.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:01.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:01.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:01.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:02.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:02.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:02.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:02.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:03.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:03.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:03.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:03.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:04.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:04.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:04.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:04.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:05.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:05.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:05.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:05.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:06.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:06.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:06.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:06.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:07.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:07.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:07.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:07.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:08.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:08.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:08.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:08.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:09.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:09.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:09.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:09.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:10.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:10.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:10.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:10.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:11.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:11.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:11.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:11.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:12.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:12.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:12.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:12.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:13.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:13.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:13.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:13.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:14.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:14.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:14.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:14.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:15.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:15.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:15.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:15.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:16.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:16.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:16.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:16.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:17.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:17.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:17.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:17.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:18.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:18.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:18.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:18.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:19.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:19.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:19.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:19.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:20.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:20.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:20.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:20.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:21.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:21.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:21.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:21.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:22.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:22.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:22.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:22.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:23.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:23.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:23.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:23.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:24.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:24.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:24.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:24.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:25.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:25.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:25.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:25.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:26.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:26.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:26.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:26.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:27.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:27.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:27.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:27.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:28.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:28.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:28.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:28.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:29.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:29.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:29.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:29.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:30.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:30.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:30.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:30.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:31.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:31.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:31.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:31.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:32.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:32.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:32.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:32.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:33.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:33.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:33.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:33.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:34.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:34.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:34.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:34.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:35.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:35.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:35.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:35.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:36.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:36.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:36.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:36.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:37.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:37.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:37.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:37.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:38.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:38.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:38.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:38.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:39.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:39.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:39.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:39.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:40.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:40.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:40.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:40.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:41.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:41.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:41.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:41.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:42.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:42.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:42.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:42.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:43.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:43.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:43.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:43.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:44.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:44.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:44.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:44.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:45.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:45.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:45.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:45.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:46.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:46.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:47.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:47.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:47.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:47.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:48.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:48.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:48.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:48.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:49.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:49.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:49.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:49.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:50.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:50.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:50.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:50.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:51.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:51.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:51.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:51.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:52.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:52.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:52.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:52.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:53.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:53.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:53.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:53.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:54.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:54.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:54.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:54.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:55.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:55.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:55.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:55.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:56.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:56.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:56.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:56.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:57.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:57.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:57.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:57.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:58.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:58.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:58.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:58.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:59.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:05:59.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:05:59.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:05:59.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:00.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:00.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:00.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:00.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:01.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:01.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:01.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:01.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:02.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:02.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:02.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:02.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:03.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:03.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:03.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:03.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:04.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:04.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:04.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:04.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:05.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:05.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:05.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:05.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:06.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:06.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:06.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:06.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:07.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:07.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:07.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:07.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:08.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:08.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:08.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:08.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:09.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:09.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:09.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:09.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:10.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:10.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:10.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:10.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:11.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:11.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:11.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:11.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:12.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:12.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:12.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:12.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:13.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:13.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:13.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:13.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:13.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:13.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:14.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:14.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:14.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:14.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:15.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:15.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:15.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:15.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:16.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:16.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:17.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:17.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:17.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:17.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:18.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:18.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:18.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:18.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:19.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:18.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:19.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:19.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:20.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:20.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:20.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:20.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:21.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:21.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:21.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:21.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:22.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:22.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:22.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:22.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:23.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:23.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:23.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:23.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:24.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:24.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:24.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:24.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:25.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:25.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:25.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:25.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:26.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:26.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:26.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:26.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:27.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:27.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:27.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:27.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:28.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:28.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:28.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:28.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:29.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:29.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:29.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:29.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:30.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:30.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:30.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:30.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:31.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:31.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:31.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:31.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:32.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:32.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:32.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:32.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:33.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:33.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:33.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:33.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:34.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:34.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:34.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:34.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:35.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:35.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:35.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:35.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:36.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:36.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:36.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:36.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:37.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:37.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:37.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:37.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:38.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:38.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:38.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:38.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:39.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:39.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:39.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:39.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:40.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:40.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:40.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:40.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:41.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:41.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:41.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:41.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:42.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:42.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:42.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:42.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:43.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:43.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:43.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:43.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:44.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:44.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:44.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:44.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:45.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:45.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:45.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:45.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:46.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:46.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:46.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:46.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:47.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:47.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:47.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:47.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:48.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:48.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:48.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:48.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:49.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:49.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:49.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:49.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:50.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:50.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:50.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:50.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:51.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:51.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:51.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:51.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:52.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:52.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:52.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:52.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:53.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:53.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:53.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:53.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:54.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:54.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:54.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:54.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:55.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:55.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:55.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:55.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:56.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:56.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:56.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:56.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:57.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:57.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:57.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:57.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:58.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:58.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:58.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:58.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:59.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:06:59.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:06:59.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:06:59.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:00.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:00.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:00.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:00.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:01.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:01.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:01.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:01.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:02.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:02.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:02.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:02.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:03.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:03.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:03.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:03.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:04.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:04.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:04.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:04.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:05.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:05.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:05.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:05.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:06.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:06.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:06.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:06.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:07.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:07.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:07.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:07.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:08.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:08.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:08.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:08.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:09.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:09.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:09.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:09.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:10.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:10.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:10.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:10.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:11.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:11.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:11.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:11.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:12.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:12.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:12.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:12.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:13.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:13.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:13.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:13.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:14.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:14.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:14.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:14.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:15.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:15.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:15.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:15.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:16.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:16.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:16.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:16.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:17.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:17.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:17.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:17.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:18.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:18.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:18.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:18.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:19.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:19.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:19.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:19.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:20.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:20.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:20.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:20.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:21.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:21.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:21.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:21.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:22.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:22.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:22.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:22.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:23.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:23.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:23.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:23.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:24.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:24.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:24.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:24.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:25.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:25.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:25.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:25.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:26.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:26.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:26.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:26.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:27.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:27.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:27.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:27.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:28.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:28.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:28.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:28.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:29.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:29.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:29.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:29.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:30.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:30.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:30.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:30.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:31.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:31.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:31.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:31.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:32.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:32.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:32.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:32.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:33.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:33.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:33.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:33.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:34.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:34.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:34.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:34.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:35.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:35.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:35.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:35.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:36.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:36.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:36.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:36.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:37.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:37.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:37.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:37.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:38.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:38.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:38.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:38.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:39.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:39.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:39.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:39.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:40.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:40.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:40.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:40.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:41.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:41.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:41.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:41.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:42.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:42.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:42.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:42.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:43.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:43.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:43.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:43.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:44.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:44.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:44.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:44.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:45.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:45.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:45.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:45.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:46.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:46.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:46.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:46.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:47.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:47.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:47.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:47.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:48.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:48.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:48.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:48.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:49.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:49.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:49.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:49.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:50.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:50.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:50.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:50.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:51.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:51.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:51.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:51.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:52.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:52.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:52.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:52.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:53.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:53.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:53.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:53.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:54.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:54.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:54.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:54.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:55.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:55.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:55.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:55.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:56.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:56.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:56.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:56.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:57.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:57.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:57.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:57.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:58.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:58.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:58.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:58.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:59.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:07:59.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:07:59.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:07:59.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:00.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:00.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:00.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:00.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:01.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:01.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:01.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:01.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:02.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:02.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:02.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:02.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:03.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:03.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:03.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:03.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:04.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:04.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:04.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:04.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:05.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:05.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:05.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:05.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:06.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:06.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:06.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:06.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:07.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:07.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:07.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:07.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:08.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:08.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:08.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:08.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:09.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:09.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:09.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:09.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:10.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:10.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:10.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:10.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:11.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:11.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:11.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:11.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:12.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:12.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:12.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:12.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:13.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:13.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:13.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:13.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:14.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:14.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:14.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:14.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:15.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:15.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:15.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:15.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:16.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:16.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:16.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:16.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:17.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:17.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:17.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:17.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:18.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:18.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:18.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:18.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:19.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:19.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:19.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:19.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:20.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:20.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:20.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:20.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:21.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:21.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:21.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:21.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:22.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:22.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:22.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:22.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:23.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:23.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:23.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:23.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:24.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:24.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:24.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:24.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:25.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:25.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:25.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:25.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:26.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:26.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:26.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:26.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:27.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:27.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:27.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:27.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:28.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:28.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:28.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:28.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:29.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:29.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:29.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:29.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:30.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:30.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:30.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:30.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:31.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:31.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:31.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:31.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:32.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:32.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:32.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:32.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:33.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:33.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:33.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:33.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:34.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:34.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:34.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:34.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:35.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:35.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:35.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:35.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:36.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:36.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:36.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:36.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:37.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:37.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:37.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:37.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:38.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:38.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:38.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:38.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:39.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:39.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:39.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:39.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:40.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:40.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:40.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:40.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:41.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:41.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:41.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:41.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:42.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:42.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:42.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:42.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:43.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:43.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:43.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:43.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:44.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:44.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:44.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:44.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:45.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:45.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:45.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:45.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:46.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:46.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:46.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:46.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:47.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:47.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:47.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:47.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:48.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:48.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:48.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:48.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:49.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:49.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:49.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:49.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:50.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:50.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:50.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:50.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:51.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:51.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:51.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:51.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:52.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:52.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:52.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:52.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:53.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:53.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:53.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:53.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:54.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:54.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:54.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:54.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:55.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:55.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:55.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:55.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:56.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:56.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:56.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:56.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:57.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:57.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:57.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:57.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:58.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:58.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:58.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:58.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:59.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:08:59.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:08:59.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:08:59.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:00.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:00.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:00.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:00.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:01.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:01.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:01.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:01.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:02.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:02.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:02.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:02.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:03.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:03.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:03.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:03.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:04.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:04.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:04.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:04.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:05.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:05.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:05.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:05.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:06.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:06.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:06.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:06.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:07.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:07.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:07.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:07.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:08.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:08.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:08.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:08.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:09.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:09.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:09.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:09.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:10.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:10.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:10.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:10.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:11.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:11.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:11.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:11.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:12.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:12.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:12.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:12.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:13.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:13.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:13.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:13.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:14.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:14.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:14.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:14.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:15.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:15.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:15.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:15.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:16.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:16.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:16.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:16.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:17.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:17.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:17.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:17.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:18.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:18.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:18.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:18.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:19.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:19.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:19.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:19.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:20.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:20.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:20.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:20.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:21.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:21.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:21.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:21.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:22.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:22.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:22.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:22.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:23.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:23.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:23.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:23.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:24.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:24.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:24.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:24.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:25.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:25.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:25.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:25.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:26.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:26.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:26.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:26.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:27.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:27.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:27.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:27.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:28.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:28.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:28.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:28.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:29.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:29.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:29.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:29.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:30.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:30.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:30.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:30.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:31.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:31.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:31.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:31.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:32.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:32.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:32.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:32.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:33.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:33.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:33.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:33.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:34.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:34.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:34.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:34.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:35.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:35.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:35.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:35.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:36.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:36.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:36.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:36.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:37.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:37.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:37.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:37.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:38.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:38.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:38.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:38.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:39.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:39.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:39.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:39.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:40.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:40.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:40.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:40.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:41.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:41.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:41.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:41.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:42.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:42.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:42.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:42.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:43.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:43.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:43.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:43.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:44.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:44.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:44.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:44.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:45.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:45.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:45.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:45.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:46.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:46.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:46.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:46.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:47.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:47.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:47.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:47.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:48.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:48.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:48.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:48.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:49.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:49.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:49.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:49.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:50.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:50.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:50.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:50.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:51.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:51.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:51.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:51.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:52.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:52.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:52.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:52.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:53.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:53.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:53.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:53.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:54.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:54.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:54.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:54.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:55.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:55.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:55.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:55.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:55.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:55.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:56.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:56.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:57.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:57.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:57.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:57.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:57.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:57.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:58.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:58.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:59.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:59.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:09:59.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:09:59.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:00.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:09:59.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:00.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:00.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:01.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:01.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:01.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:01.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:02.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:02.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:02.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:02.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:03.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:03.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:03.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:03.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:04.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:04.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:04.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:04.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:05.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:05.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:05.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:05.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:06.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:06.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:06.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:06.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:07.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:07.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:07.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:07.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:08.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:08.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:08.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:08.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:09.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:09.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:09.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:09.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:10.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:10.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:10.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:10.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:11.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:11.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:11.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:11.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:12.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:12.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:12.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:12.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:13.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:13.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:13.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:13.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:14.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:14.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:14.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:14.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:15.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:15.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:15.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:15.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:15.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:15.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:16.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:16.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:17.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:17.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:17.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:17.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:18.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:18.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:18.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:18.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:19.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:19.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:19.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:19.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:20.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:20.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:20.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:20.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:21.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:21.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:21.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:21.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:22.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:22.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:22.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:22.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:23.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:23.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:23.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:23.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:24.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:24.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:24.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:24.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:25.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:25.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:25.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:25.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:26.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:26.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:26.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:26.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:27.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:27.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:27.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:27.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:28.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:28.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:28.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:28.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:29.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:29.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:29.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:29.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:30.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:30.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:30.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:30.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:31.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:31.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:31.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:31.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:32.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:32.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:32.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:32.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:33.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:33.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:33.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:33.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:34.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:34.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:34.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:34.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:35.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:35.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:35.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:35.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:36.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:36.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:36.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:36.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:37.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:37.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:37.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:37.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:38.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:38.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:38.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:38.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:39.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:39.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:39.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:39.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:40.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:40.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:40.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:40.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:41.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:41.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:41.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:41.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:42.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:42.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:42.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:42.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:43.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:43.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:43.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:43.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:44.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:44.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:44.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:44.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:45.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:45.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:46.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:46.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:46.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:46.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:47.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:47.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:47.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:47.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:48.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:48.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:48.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:48.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:49.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:49.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:49.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:49.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:49.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:49.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:50.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:50.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:50.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:50.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:51.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:51.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:51.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:51.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:52.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:52.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:53.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:53.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:53.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:53.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:54.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:54.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:54.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:54.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:55.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:55.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:55.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:55.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:56.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:56.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:56.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:56.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:57.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:57.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:57.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:57.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:58.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:58.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:58.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:58.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:59.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:10:59.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:10:59.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:10:59.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:00.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:00.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:00.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:00.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:00.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:00.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:01.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:01.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:01.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:01.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:02.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:02.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:02.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:02.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:03.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:03.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:03.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:03.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:04.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:04.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:04.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:04.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:05.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:05.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:05.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:05.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:06.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:06.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:06.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:06.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:07.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:07.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:07.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:07.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:08.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:08.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:08.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:08.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:09.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:09.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:09.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:09.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:10.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:10.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:10.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:10.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:11.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:11.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:11.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:11.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:12.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:12.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:12.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:12.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:13.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:13.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:13.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:13.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:14.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:14.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:14.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:14.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:15.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:15.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:15.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:15.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:16.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:16.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:16.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:16.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:17.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:17.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:17.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:17.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:18.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:18.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:18.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:18.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:19.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:19.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:19.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:19.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:20.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:20.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:20.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:20.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:21.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:21.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:21.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:21.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:22.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:22.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:22.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:22.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:23.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:23.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:23.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:23.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:24.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:24.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:24.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:24.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:25.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:25.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:25.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:25.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:26.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:26.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:26.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:26.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:27.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:27.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:27.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:27.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:28.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:28.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:28.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:28.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:29.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:29.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:29.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:29.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:30.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:30.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:30.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:30.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:31.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:31.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:31.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:31.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:32.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:32.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:32.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:32.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:33.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:33.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:33.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:33.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:34.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:34.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:34.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:34.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:35.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:35.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:35.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:35.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:36.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:36.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:36.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:36.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:37.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:37.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:37.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:37.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:38.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:38.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:38.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:38.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:39.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:39.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:39.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:39.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:40.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:40.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:40.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:40.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:41.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:41.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:41.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:41.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:42.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:42.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:42.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:42.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:43.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:43.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:43.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:43.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:44.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:43.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:44.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:44.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:44.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:44.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:45.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:45.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:45.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:45.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:46.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:46.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:46.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:46.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:47.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:47.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:47.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:47.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:48.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:48.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:48.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:48.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:49.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:49.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:49.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:49.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:50.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:50.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:50.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:50.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:51.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:51.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:51.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:51.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:52.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:52.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:52.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:52.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:53.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:53.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:53.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:53.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:54.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:54.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:54.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:54.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:55.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:55.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:55.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:55.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:56.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:56.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:56.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:56.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:57.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:57.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:57.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:57.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:58.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:58.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:58.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:58.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:59.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:11:59.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:11:59.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:11:59.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:00.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:00.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:00.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:00.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:01.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:01.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:01.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:01.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:02.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:02.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:02.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:02.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:03.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:03.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:03.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:03.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:04.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:04.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:04.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:04.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:05.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:05.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:05.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:05.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:06.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:06.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:06.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:06.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:07.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:07.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:07.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:07.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:08.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:08.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:08.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:08.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:09.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:09.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:09.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:09.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:10.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:10.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:10.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:10.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:11.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:11.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:11.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:11.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:12.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:12.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:12.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:12.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:13.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:13.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:13.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:13.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:14.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:14.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:14.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:14.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:15.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:15.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:15.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:15.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:16.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:16.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:16.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:16.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:17.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:17.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:17.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:17.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:18.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:18.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:18.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:18.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:19.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:19.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:19.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:19.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:20.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:20.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:20.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:20.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:21.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:21.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:21.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:21.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:22.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:22.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:22.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:22.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:23.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:23.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:23.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:23.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:24.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:24.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:24.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:24.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:25.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:25.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:25.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:25.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:26.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:26.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:26.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:26.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:27.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:27.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:27.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:27.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:28.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:28.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:28.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:28.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:29.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:29.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:29.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:29.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:30.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:30.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:30.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:30.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:31.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:31.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:31.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:31.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:32.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:32.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:32.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:32.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:33.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:33.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:33.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:33.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:34.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:34.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:34.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:34.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:35.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:35.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:35.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:35.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:36.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:36.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:36.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:36.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:37.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:37.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:37.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:37.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:38.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:38.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:38.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:38.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:39.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:39.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:39.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:39.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:40.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:40.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:40.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:40.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:41.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:41.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:41.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:41.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:42.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:42.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:42.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:42.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:43.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:43.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:43.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:43.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:44.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:44.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:44.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:44.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:45.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:45.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:46.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:46.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:46.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:46.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:46.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:46.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:47.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:47.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:47.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:47.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:48.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:48.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:48.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:48.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:49.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:49.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:49.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:49.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:50.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:50.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:50.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:50.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:51.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:51.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:51.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:51.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:52.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:52.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:52.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:52.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:53.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:53.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:53.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:53.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:54.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:54.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:54.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:54.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:55.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:55.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:55.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:55.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:56.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:56.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:56.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:56.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:57.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:57.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:57.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:57.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:58.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:58.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:59.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:12:59.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:12:59.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:12:59.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:00.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:00.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:00.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:00.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:01.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:01.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:01.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:01.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:02.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:02.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:02.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:02.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:03.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:03.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:03.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:03.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:04.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:04.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:04.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:04.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:05.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:04.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:05.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:05.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:05.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:05.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:06.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:06.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:06.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:06.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:07.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:07.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:07.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:07.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:08.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:08.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:08.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:08.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:09.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:09.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:09.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:09.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:10.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:10.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:10.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:10.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:11.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:11.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:11.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:11.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:12.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:12.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:12.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:12.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:13.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:13.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:13.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:13.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:14.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:14.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:14.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:14.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:15.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:15.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:15.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:15.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:16.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:16.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:16.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:16.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:17.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:17.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:17.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:17.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:18.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:18.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:18.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:18.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:19.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:19.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:19.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:19.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:20.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:20.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:20.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:20.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:21.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:21.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:21.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:21.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:22.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:22.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:22.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:22.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:23.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:23.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:23.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:23.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:24.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:24.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:24.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:24.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:25.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:25.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:25.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:25.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:26.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:26.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:26.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:26.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:27.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:27.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:27.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:27.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:28.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:28.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:28.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:28.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:29.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:29.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:29.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:29.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:30.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:30.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:30.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:30.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:31.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:31.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:31.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:31.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:32.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:32.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:32.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:32.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:33.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:33.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:33.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:33.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:34.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:34.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:34.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:34.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:35.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:35.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:35.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:35.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:36.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:36.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:36.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:36.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:37.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:37.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:37.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:37.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:38.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:38.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:38.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:38.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:39.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:39.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:39.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:39.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:40.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:40.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:40.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:40.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:41.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:41.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:42.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:42.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:42.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:42.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:42.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:42.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:43.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:43.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:43.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:43.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:44.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:44.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:44.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:44.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:45.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:45.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:45.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:45.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:46.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:46.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:46.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:46.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:47.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:47.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:48.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:48.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:48.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:48.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:49.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:49.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:49.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:49.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:50.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:50.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:50.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:50.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:51.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:51.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:51.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:51.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:52.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:52.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:52.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:52.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:53.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:53.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:53.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:53.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:53.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:53.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:54.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:54.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:55.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:55.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:55.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:55.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:56.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:56.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:56.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:56.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:57.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:57.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:57.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:57.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:58.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:58.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:58.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:58.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:59.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:13:59.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:13:59.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:13:59.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:00.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:00.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:00.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:00.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:01.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:01.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:01.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:01.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:02.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:02.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:02.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:02.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:03.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:03.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:03.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:03.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:04.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:04.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:04.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:04.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:05.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:05.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:05.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:05.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:06.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:06.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:06.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:06.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:06.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:06.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:07.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:07.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:07.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:07.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:08.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:08.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:08.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:08.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:09.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:09.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:09.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:09.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:10.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:10.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:10.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:10.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:11.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:11.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:11.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:11.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:12.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:12.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:13.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:13.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:13.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:13.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:14.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:14.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:14.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:14.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:15.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:15.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:15.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:15.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:16.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:16.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:16.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:16.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:17.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:17.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:17.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:17.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:18.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:18.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:18.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:18.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:19.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:19.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:19.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:19.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:20.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:20.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:20.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:20.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:21.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:21.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:21.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:21.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:22.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:22.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:22.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:22.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:23.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:23.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:23.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:23.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:24.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:24.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:24.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:24.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:25.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:25.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:25.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:25.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:26.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:26.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:26.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:26.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:27.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:27.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:27.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:27.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:28.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:28.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:28.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:28.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:29.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:29.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:29.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:29.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:30.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:30.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:30.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:30.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:31.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:31.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:31.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:31.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:32.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:32.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:32.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:32.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:33.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:33.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:33.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:33.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:34.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:34.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:34.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:34.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:35.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:35.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:35.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:35.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:36.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:36.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 87 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:36.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:36.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:37.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:37.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:37.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:37.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:38.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:38.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:38.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:38.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:39.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:39.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:39.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:39.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:40.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:40.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:40.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:40.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:41.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:41.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:41.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:41.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:42.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:42.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:42.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:42.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:43.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:43.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:43.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:43.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:44.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:44.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:44.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:44.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:45.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:45.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:45.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:45.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:46.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:46.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:46.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:46.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:47.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:47.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:47.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:47.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:48.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:48.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:48.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:48.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:49.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:49.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:49.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:49.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:50.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:50.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:50.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:50.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:51.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:51.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:51.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:51.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:52.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:52.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:52.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:52.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:53.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:53.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:53.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:53.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:54.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:54.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:54.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:54.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:55.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:55.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:55.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:55.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:56.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:56.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:56.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:56.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:57.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:57.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:57.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:57.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:58.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:58.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:14:58.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:58.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:59.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:14:59.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:14:59.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:14:59.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:00.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:00.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:15:00.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:00.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:01.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:01.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:15:01.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:01.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:02.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:02.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:15:02.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:02.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:03.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:03.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:15:03.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:03.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:04.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:04.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:15:04.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:04.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:05.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:05.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 37 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:15:05.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:05.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:06.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:06.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:06.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:06.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:07.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:07.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:07.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:07.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:08.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:08.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:08.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:08.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:09.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:09.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:09.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:09.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:10.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:10.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:10.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:10.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:11.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:11.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:11.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:11.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:12.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:12.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:12.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:12.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:13.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:13.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:13.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:13.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:14.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:14.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:14.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:14.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:15.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:15.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:15.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:15.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:16.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:16.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:16.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:16.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:17.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:17.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:17.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:17.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:18.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:18.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:18.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:18.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:19.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:19.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:19.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:19.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:20.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:20.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:20.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:20.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:21.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:21.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:21.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:21.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:22.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:22.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:22.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:22.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:23.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:23.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:23.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:23.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:24.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:24.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:24.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:24.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:25.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:25.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:25.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:25.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:26.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:26.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:26.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:26.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:27.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:27.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:27.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:27.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:28.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:28.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:28.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:28.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:29.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:29.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:29.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:29.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:30.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:30.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:30.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:30.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:31.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:31.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:31.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:31.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:32.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:32.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:32.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:32.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:33.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:33.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:33.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:33.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:34.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:34.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:34.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:34.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:35.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:35.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:35.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:35.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:36.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:36.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:36.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:36.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:37.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:37.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:37.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:37.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:38.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:38.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:38.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:38.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:39.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:39.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:39.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:39.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:40.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:40.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:40.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:40.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:41.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:41.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:41.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:41.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:42.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:42.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:42.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:42.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:43.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:43.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:43.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:43.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:44.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:44.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:44.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:44.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:45.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:45.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:45.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:45.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:46.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:46.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:46.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:46.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:47.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:47.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:47.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:47.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:48.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:48.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:48.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:48.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:49.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:49.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:49.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:49.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:50.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:50.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:50.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:50.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:51.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:51.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:51.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:51.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:52.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:52.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:52.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:52.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:53.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:53.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:53.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:53.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:54.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:54.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:54.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:54.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:55.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:55.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:55.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:55.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:56.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:56.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:56.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:56.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:57.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:57.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:57.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:57.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:58.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:58.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:58.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:58.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:59.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:15:59.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:15:59.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:15:59.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:00.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:00.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:00.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:00.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:01.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:01.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:01.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:01.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:02.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:02.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:02.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:02.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:03.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:03.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:03.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:03.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:04.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:04.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:04.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:04.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:05.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:05.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:05.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:05.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:06.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:06.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:06.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:06.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:07.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:07.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:07.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:07.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:08.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:08.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:08.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:08.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:09.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:09.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:09.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:09.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:10.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:10.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:10.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:10.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:11.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:11.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:11.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:11.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:12.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:12.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:12.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:12.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:13.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:13.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:13.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:13.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:14.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:14.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:14.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:14.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:15.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:15.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:15.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:15.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:16.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:16.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:16.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:16.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:17.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:17.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:17.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:17.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:18.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:18.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:18.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:18.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:19.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:19.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:19.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:19.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:20.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:20.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:20.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:20.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:21.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:21.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:21.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:21.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:22.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:22.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:22.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:22.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:23.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:23.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:23.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:23.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:24.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:24.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:24.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:24.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:25.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:25.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:25.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:25.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:26.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:26.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:26.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:26.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:27.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:27.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:27.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:27.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:28.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:28.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:28.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:28.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:29.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:29.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:29.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:29.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:30.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:30.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:30.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:30.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:31.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:31.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:31.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:31.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:32.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:32.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:32.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:32.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:33.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:33.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:33.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:33.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:34.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:34.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:34.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:34.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:35.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:35.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:35.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:35.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:36.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:36.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:36.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:36.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:37.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:37.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:37.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:37.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:38.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:38.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:38.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:38.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:39.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:39.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:39.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:39.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:40.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:40.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:40.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:40.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:41.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:41.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:41.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:41.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:42.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:42.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:42.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:42.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:43.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:43.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:43.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:43.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:44.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:44.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:44.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:44.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:45.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:45.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:45.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:45.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:46.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:46.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:46.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:46.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:47.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:47.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:47.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:47.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:48.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:48.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:48.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:48.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:49.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:49.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:49.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:49.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:50.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:50.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:50.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:50.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:51.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:51.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:51.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:51.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:52.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:52.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:52.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:52.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:53.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:53.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:53.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:53.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:54.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:54.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:54.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:54.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:55.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:55.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:55.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:55.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:56.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:56.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:56.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:56.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:57.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:57.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:57.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:57.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:58.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:58.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:58.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:58.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:59.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:16:59.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:16:59.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:16:59.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:00.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:00.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:00.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:00.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:01.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:01.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:01.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:01.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:02.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:02.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:02.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:02.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:03.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:03.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:03.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:03.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:04.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:04.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:04.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:04.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:05.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:05.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:05.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:05.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:06.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:06.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:06.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:06.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:07.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:07.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:07.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:07.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:08.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:08.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:08.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:08.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:09.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:09.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:09.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:09.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:10.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:10.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:10.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:10.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:11.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:11.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:11.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:11.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:12.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:12.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:12.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:12.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:13.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:13.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:13.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:13.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:14.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:14.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:14.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:14.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:15.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:15.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:15.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:15.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:16.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:16.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:16.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:16.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:17.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:17.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:17.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:17.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:18.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:18.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:18.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:18.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:19.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:19.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:19.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:19.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:20.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:20.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:20.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:20.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:21.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:21.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:21.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:21.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:22.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:22.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:22.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:22.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:23.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:23.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:23.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:23.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:24.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:24.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:24.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:24.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:25.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:25.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:25.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:25.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:26.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:26.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:26.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:26.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:27.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:27.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:27.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:27.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:28.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:28.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:28.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:28.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:29.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:29.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:29.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:29.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:30.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:30.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:30.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:30.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:31.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:31.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:31.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:31.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:32.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:32.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:32.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:32.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:33.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:33.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:33.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:33.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:34.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:34.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:34.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:34.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:35.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:35.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:35.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:35.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:36.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:36.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:36.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:36.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:37.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:37.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:37.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:37.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:38.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:38.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:38.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:38.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:39.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:39.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:39.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:39.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:40.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:40.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:40.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:40.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:41.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:41.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:41.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:41.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:42.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:42.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:42.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:42.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:43.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:43.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:43.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:43.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:44.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:44.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:44.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:44.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:45.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:45.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:45.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:45.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:46.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:46.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:46.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:46.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:47.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:47.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:47.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:47.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:48.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:48.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:48.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:48.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:49.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:49.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:49.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:49.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:50.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:50.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:50.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:50.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:51.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:51.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:51.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:51.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:52.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:52.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:52.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:52.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:53.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:53.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:53.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:53.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:54.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:54.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:54.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:54.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:55.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:55.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:55.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:55.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:56.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:56.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:56.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:56.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:57.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:57.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:57.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:57.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:58.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:58.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:58.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:58.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:59.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:17:59.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:17:59.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:17:59.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:00.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:00.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:00.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:00.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:01.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:01.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:01.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:01.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:02.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:02.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:02.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:02.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:03.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:03.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:03.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:03.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:04.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:04.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:04.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:04.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:05.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:05.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:05.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:05.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:06.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:06.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:06.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:06.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:07.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:07.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:07.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:07.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:08.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:08.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:08.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:08.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:09.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:09.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:09.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:09.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:10.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:10.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:10.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:10.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:11.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:11.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:11.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:11.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:12.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:12.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:12.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:12.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:13.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:13.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:13.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:13.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:14.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:14.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:14.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:14.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:15.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:15.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:15.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:15.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:16.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:16.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:16.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:16.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:17.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:17.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:17.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:17.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:18.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:18.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:18.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:18.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:19.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:19.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:19.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:19.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:20.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:20.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:20.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:20.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:21.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:21.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:21.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:21.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:22.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:22.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:23.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:23.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:23.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:23.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:24.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:24.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:24.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:24.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:25.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:24.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:25.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:25.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:26.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:26.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:26.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:26.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:27.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:27.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:27.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:27.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:28.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:28.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:28.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:28.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:29.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:29.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:29.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:29.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:30.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:30.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:30.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:30.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:31.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:31.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:31.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:31.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:32.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:32.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:32.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:32.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:33.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:33.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:33.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:33.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:34.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:34.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:34.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:34.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:35.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:35.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:35.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:35.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:36.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:36.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:36.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:36.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:37.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:37.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:37.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:37.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:38.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:38.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:38.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:38.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:39.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:39.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:39.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:39.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:40.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:40.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:40.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:40.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:41.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:41.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:41.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:41.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:42.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:42.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:42.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:42.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:43.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:43.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:43.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:43.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:44.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:44.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:44.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:44.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:45.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:45.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:45.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:45.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:46.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:46.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:46.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:46.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:47.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:47.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:47.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:47.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:48.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:48.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:48.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:48.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:49.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:49.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:49.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:49.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:50.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:50.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:50.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:50.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:51.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:51.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:51.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:51.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:52.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:52.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:52.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:52.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:53.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:53.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:53.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:53.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:54.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:54.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:54.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:54.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:55.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:55.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:55.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:55.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:56.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:56.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:56.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:56.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:57.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:57.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:57.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:57.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:58.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:58.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:58.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:58.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:59.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:18:59.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:18:59.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:18:59.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:00.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:00.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:00.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:00.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:01.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:01.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:01.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:01.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:02.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:02.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:02.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:02.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:03.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:03.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:03.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:03.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:04.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:04.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:04.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:04.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:05.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:05.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:05.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:05.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:06.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:06.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:06.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:06.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:07.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:07.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:07.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:07.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:08.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:08.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:08.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:08.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:09.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:09.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:09.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:09.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:10.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:10.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:10.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:10.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:11.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:11.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:11.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:11.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:12.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:12.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:12.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:12.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:13.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:13.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:13.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:13.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:14.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:14.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:14.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:14.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:15.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:15.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:15.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:15.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:16.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:16.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:16.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:16.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:17.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:17.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:17.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:17.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:18.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:18.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:18.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:18.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:19.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:19.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:19.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:19.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:20.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:20.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:20.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:20.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:21.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:21.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:21.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:21.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:22.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:22.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:22.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:22.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:23.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:23.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:23.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:23.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:24.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:24.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:24.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:24.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:25.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:25.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:25.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:25.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:26.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:26.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:26.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:26.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:27.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:27.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:27.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:27.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:28.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:28.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:28.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:28.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:29.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:29.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:29.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:29.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:30.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:30.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:30.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:30.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:31.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:31.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:31.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:31.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:32.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:32.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:32.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:32.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:33.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:33.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:33.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:33.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:34.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:34.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:34.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:34.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:35.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:35.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:35.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:35.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:36.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:36.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:36.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:36.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:37.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:37.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:37.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:37.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:38.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:38.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:38.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:38.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:39.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:39.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:39.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:39.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:40.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:40.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:40.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:40.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:41.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:41.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:41.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:41.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:42.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:42.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:42.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:42.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:43.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:43.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:43.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:43.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:44.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:44.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:44.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:44.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:45.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:45.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:45.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:45.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:46.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:46.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:46.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:46.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:47.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:47.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:47.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:47.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:48.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:48.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:48.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:48.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:49.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:49.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:49.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:49.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:50.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:50.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:50.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:50.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:51.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:51.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:51.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:51.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:52.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:52.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:52.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:52.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:53.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:53.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:53.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:53.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:54.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:54.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:54.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:54.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:55.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:55.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:55.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:55.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:56.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:56.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:56.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:56.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:57.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:57.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:57.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:57.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:58.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:58.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:58.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:58.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:59.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:19:59.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:19:59.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:19:59.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:00.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:00.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:00.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:00.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:01.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:01.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:01.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:01.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:02.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:02.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:02.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:02.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:03.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:03.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:03.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:03.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:04.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:04.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:04.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:04.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:05.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:05.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:05.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:05.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:06.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:06.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:06.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:06.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:07.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:07.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:07.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:07.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:08.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:08.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:08.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:08.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:09.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:09.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:09.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:09.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:10.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:10.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:10.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:10.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:11.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:11.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:11.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:11.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:12.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:12.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:12.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:12.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:13.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:13.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:13.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:13.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:14.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:14.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:14.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:14.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:15.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:15.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:15.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:15.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:16.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:16.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:16.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:16.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:17.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:17.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:17.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:17.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:18.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:18.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:18.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:18.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:19.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:19.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:19.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:19.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:20.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:20.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:20.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:20.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:21.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:21.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:21.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:21.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:22.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:22.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:22.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:22.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:23.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:23.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:23.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:23.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:24.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:24.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:24.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:24.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:25.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:25.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:25.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:25.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:26.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:26.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:26.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:26.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:27.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:27.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:27.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:27.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:28.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:28.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:28.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:28.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:29.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:29.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:29.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:29.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:30.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:30.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:30.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:30.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:31.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:31.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:31.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:31.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:32.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:32.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:32.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:32.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:33.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:33.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:33.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:33.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:34.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:34.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:34.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:34.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:35.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:35.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:35.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:35.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:36.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:36.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:36.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:36.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:37.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:37.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:37.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:37.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:38.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:38.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:38.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:38.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:39.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:39.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:39.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:39.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:40.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:40.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:40.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:40.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:41.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:41.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:41.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:41.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:42.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:42.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:42.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:42.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:43.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:43.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:43.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:43.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:44.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:44.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:44.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:44.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:45.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:45.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:45.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:45.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:46.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:46.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:46.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:46.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:47.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:47.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:47.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:47.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:48.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:48.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:48.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:48.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:49.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:49.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:49.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:49.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:50.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:50.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:50.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:50.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:51.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:51.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:51.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:51.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:52.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:52.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:52.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:52.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:53.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:53.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:53.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:53.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:54.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:54.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:54.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:54.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:55.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:55.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:55.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:55.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:56.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:56.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:56.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:56.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:57.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:57.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:57.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:57.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:58.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:58.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:58.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:58.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:59.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:20:59.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:20:59.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:20:59.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:00.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:00.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:00.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:00.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:01.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:01.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:01.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:01.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:02.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:02.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:02.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:02.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:03.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:03.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:03.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:03.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:04.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:04.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:04.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:04.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:05.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:05.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:05.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:05.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:06.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:06.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:06.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:06.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:07.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:07.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:07.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:07.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:08.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:08.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:08.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:08.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:09.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:09.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:09.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:09.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:10.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:10.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:10.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:10.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:11.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:11.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:11.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:11.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:12.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:12.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:12.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:12.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:13.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:13.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:13.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:13.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:14.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:14.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:14.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:14.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:15.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:15.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:15.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:15.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:16.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:16.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:16.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:16.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:17.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:17.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:17.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:17.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:18.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:18.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:18.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:18.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:19.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:19.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:19.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:19.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:20.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:20.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:20.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:20.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:21.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:21.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:21.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:21.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:22.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:22.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:22.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:22.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:23.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:23.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:23.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:23.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:24.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:24.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:24.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:24.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:25.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:25.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:25.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:25.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:26.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:26.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:26.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:26.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:27.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:27.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:27.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:27.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:28.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:28.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:28.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:28.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:29.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:29.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:29.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:29.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:30.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:30.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:30.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:30.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:31.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:31.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:31.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:31.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:32.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:32.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:32.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:32.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:33.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:33.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:33.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:33.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:34.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:34.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:34.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:34.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:35.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:35.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:35.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:35.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:36.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:36.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:36.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:36.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:37.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:37.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:37.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:37.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:38.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:38.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:38.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:38.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:39.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:39.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:39.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:39.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:40.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:40.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:40.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:40.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:41.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:41.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:41.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:41.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:42.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:42.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:42.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:42.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:43.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:43.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:43.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:43.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:44.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:44.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:44.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:44.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:45.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:45.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:45.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:45.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:46.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:46.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:46.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:46.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:47.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:47.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:47.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:47.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:48.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:48.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:48.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:48.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:49.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:49.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:49.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:49.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:50.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:50.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:50.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:50.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:51.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:51.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:51.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:51.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:52.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:52.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:52.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:52.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:53.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:53.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:53.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:53.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:54.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:54.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:54.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:54.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:55.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:55.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:55.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:55.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:56.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:56.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:56.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:56.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:57.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:57.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:57.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:57.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:58.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:58.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:58.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:58.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:59.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:21:59.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:21:59.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:21:59.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:00.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:00.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:00.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:00.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:01.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:01.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:01.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:01.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:02.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:02.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:02.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:02.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:03.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:03.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:03.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:03.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:04.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:04.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:04.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:04.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:05.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:05.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:05.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:05.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:06.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:06.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:06.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:06.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:07.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:07.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:07.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:07.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:08.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:08.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:08.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:08.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:09.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:09.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:09.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:09.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:10.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:10.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:10.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:10.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:11.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:11.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:11.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:11.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:12.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:12.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:12.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:12.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:13.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:13.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:13.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:13.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:14.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:14.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:14.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:14.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:15.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:15.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:15.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:15.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:16.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:16.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:16.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:16.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:17.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:17.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:17.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:17.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:18.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:18.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:18.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:18.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:19.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:19.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:19.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:19.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:20.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:20.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:20.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:20.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:21.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:21.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:21.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:21.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:22.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:22.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:22.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:22.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:23.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:23.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:23.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:23.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:24.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:24.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:24.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:24.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:25.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:25.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:25.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:25.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:26.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:26.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:26.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:26.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:27.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:27.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:27.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:27.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:28.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:28.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:28.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:28.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:29.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:29.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:29.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:29.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:30.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:30.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:30.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:30.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:31.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:31.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:31.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:31.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:32.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:32.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:32.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:32.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:33.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:33.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:33.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:33.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:34.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:34.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:34.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:34.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:35.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:35.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:35.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:35.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:36.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:36.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:36.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:36.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:37.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:37.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:37.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:37.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:38.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:38.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:38.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:38.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:39.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:39.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:39.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:39.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:40.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:40.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:40.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:40.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:41.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:41.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:41.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:41.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:42.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:42.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:42.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:42.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:43.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:43.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:43.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:43.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:44.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:44.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:44.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:44.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:45.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:45.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:45.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:45.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:46.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:46.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:46.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:46.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:47.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:47.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:47.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:47.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:48.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:48.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:48.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:48.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:49.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:49.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:49.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:49.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:50.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:50.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:50.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:50.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:51.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:51.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:51.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:51.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:52.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:52.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:52.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:52.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:53.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:53.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:53.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:53.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:54.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:54.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:54.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:54.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:55.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:55.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:55.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:55.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:56.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:56.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:56.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:56.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:57.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:57.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:57.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:57.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:58.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:58.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:58.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:58.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:59.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:22:59.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:22:59.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:22:59.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:00.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:00.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:00.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:00.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:01.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:01.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:01.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:01.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:02.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:02.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:02.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:02.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:03.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:03.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:03.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:03.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:04.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:04.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:04.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:04.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:05.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:05.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:05.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:05.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:06.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:06.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:06.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:06.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:07.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:07.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:07.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:07.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:08.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:08.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:08.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:08.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:09.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:09.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:09.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:09.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:10.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:10.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:10.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:10.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:11.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:11.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:11.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:11.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:12.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:12.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:12.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:12.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:13.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:13.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:13.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:13.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:14.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:14.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:14.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:14.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:15.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:15.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:15.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:15.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:16.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:16.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:16.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:16.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:17.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:17.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:17.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:17.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:18.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:18.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:18.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:18.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:19.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:19.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:19.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:19.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:20.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:20.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:20.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:20.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:21.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:21.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:21.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:21.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:22.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:22.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:22.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:22.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:23.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:23.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:23.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:23.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:24.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:24.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:24.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:24.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:25.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:25.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:25.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:25.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:26.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:26.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:26.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:26.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:27.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:27.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:27.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:27.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:28.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:28.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:28.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:28.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:29.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:29.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:29.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:29.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:30.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:30.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:30.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:30.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:31.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:31.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:31.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:31.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:32.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:32.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:32.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:32.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:33.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:33.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:33.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:33.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:34.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:34.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:34.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:34.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:35.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:35.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:35.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:35.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:36.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:36.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:36.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:36.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:37.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:37.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:37.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:37.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:38.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:38.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:38.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:38.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:39.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:39.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:39.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:39.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:40.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:40.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:40.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:40.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:41.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:41.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:41.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:41.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:42.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:42.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:42.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:42.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:43.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:43.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:43.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:43.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:44.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:44.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:44.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:44.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:45.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:45.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:45.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:45.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:46.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:46.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:46.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:46.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:47.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:47.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:47.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:47.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:48.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:48.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:48.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:48.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:49.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:49.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:49.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:49.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:50.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:50.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:50.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:50.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:51.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:51.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:51.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:51.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:52.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:52.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:52.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:52.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:53.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:53.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:53.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:53.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:54.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:54.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:54.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:54.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:55.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:55.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:56.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:56.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:56.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:56.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:57.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:57.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:57.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:57.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:58.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:58.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:58.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:58.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:59.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:23:59.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:23:59.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:23:59.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:00.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:00.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:00.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:00.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:01.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:01.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:01.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:01.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:02.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:02.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:02.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:02.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:03.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:03.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:03.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:03.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:04.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:04.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:04.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:04.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:05.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:05.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:05.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:05.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:06.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:06.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:06.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:06.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:07.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:07.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:07.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:07.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:08.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:08.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:08.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:08.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:09.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:09.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:09.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:09.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:10.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:10.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:10.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:10.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:11.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:11.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:11.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:11.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:12.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:12.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:12.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:12.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:13.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:13.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:13.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:13.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:14.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:14.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:14.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:14.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:15.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:15.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:15.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:15.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:16.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:16.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:16.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:16.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:17.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:17.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:17.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:17.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:18.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:18.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:18.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:18.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:19.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:19.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:19.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:19.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:20.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:19.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:20.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:20.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:21.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:21.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:21.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:21.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:22.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:22.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:22.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:22.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:23.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:23.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:23.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:23.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:24.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:24.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:24.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:24.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:25.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:25.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:25.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:25.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:26.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:26.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:26.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:26.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:27.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:27.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:27.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:27.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:28.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:28.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:28.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:28.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:29.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:29.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:29.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:29.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:30.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:30.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:30.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:30.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:31.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:31.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:31.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:31.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:32.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:32.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:32.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:32.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:33.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:33.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:33.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:33.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:34.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:34.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:34.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:34.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:35.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:35.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:35.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:35.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:36.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:36.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:36.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:36.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:37.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:37.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:37.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:37.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:38.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:38.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:38.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:38.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:39.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:39.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:39.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:39.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:40.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:40.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:40.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:40.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:41.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:41.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:41.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:41.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:42.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:42.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:42.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:42.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:42.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:42.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:43.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:43.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:44.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:44.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:44.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:44.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:44.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:44.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:45.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:45.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:45.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:45.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:46.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:46.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:46.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:46.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:47.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:47.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:47.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:47.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:48.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:48.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:48.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:48.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:49.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:49.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:50.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:50.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:50.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:50.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:50.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:50.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:51.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:51.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:51.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:51.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:52.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:52.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:53.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:53.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:53.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:53.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:54.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:54.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:54.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:54.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:55.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:55.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:55.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:55.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:56.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:56.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:56.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:56.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:57.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:57.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:57.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:57.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:58.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:58.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:58.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:58.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:59.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:24:59.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:24:59.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:24:59.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:00.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:00.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:00.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:00.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:01.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:01.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:01.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:01.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:02.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:02.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:02.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:02.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:02.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:02.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:03.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:03.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:04.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:04.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:04.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:04.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:04.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:04.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:05.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:05.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:05.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:05.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:06.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:06.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:06.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:06.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:07.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:07.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:07.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:07.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:08.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:08.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:08.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:08.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:09.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:09.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:09.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:09.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:10.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:10.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:10.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:10.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:11.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:10.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:11.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:11.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:12.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:12.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:12.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:12.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:13.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:13.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:13.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:13.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:14.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:14.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:14.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:14.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:15.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:15.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:15.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:15.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:16.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:15.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:16.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:16.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:16.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:16.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:17.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:17.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:18.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:17.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:18.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:18.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:18.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:18.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:20.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:19.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:20.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:19.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:20.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:20.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:21.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:21.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:21.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:21.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:22.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:22.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:22.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:22.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:22.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:22.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:23.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:23.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:23.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:23.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:24.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:24.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:24.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:24.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:25.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:25.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:25.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:25.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:26.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:26.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:26.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:26.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:27.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:27.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:27.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:27.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:28.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:28.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:28.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:28.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:29.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:29.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:29.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:29.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:30.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:30.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:30.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:30.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:31.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:31.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:31.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:31.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:32.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:32.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:32.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:32.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:33.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:33.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:33.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:33.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:34.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:34.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:34.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:34.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:35.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:35.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:35.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:35.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:36.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:36.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:36.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:36.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:37.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:37.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:37.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:37.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:38.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:38.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:38.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:38.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:39.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:39.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:39.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:39.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:40.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:40.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:40.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:40.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:41.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:41.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:41.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:41.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:42.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:42.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:42.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:42.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:43.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:43.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:43.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:43.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:44.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:44.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:44.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:44.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:45.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:45.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:45.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:45.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:46.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:46.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:46.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:46.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:47.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:47.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:47.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:47.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:48.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:48.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:48.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:48.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:49.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:49.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:49.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:49.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:50.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:50.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:50.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:50.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:51.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:51.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:51.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:51.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:52.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:52.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:52.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:52.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:53.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:53.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:53.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:53.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:54.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:54.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:54.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:54.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:55.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:55.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:55.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:55.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:56.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:56.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:56.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:56.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:57.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:57.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:57.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:57.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:58.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:58.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:58.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:58.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:59.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:25:59.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:25:59.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:25:59.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:00.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:00.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:00.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:00.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:01.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:01.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:01.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:01.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 90 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:02.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:02.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:02.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:02.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:03.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:03.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:03.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:03.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:04.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:04.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:04.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:04.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:05.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:05.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:05.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:05.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:06.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:06.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:06.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:06.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:07.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:07.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:07.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:07.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:08.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:08.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:08.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:08.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:09.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:09.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:09.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:09.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:10.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:10.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:10.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:10.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:11.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:11.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:11.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:11.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:12.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:12.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:12.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:12.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:13.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:13.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:13.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:13.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:14.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:14.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:14.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:14.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:15.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:15.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:15.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:15.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:16.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:16.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:16.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:16.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:17.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:17.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:17.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:17.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:18.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:18.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:18.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:18.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:19.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:19.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:19.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:19.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:20.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:20.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:20.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:20.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:21.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:21.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:21.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:21.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:22.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:22.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:22.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:22.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:23.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:23.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:23.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:23.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:24.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:24.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:24.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:24.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:25.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:25.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:25.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:25.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:26.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:26.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:27.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:26.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:27.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:27.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:28.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:28.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:28.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:28.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:28.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:28.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:29.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:29.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:29.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:29.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:30.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:30.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:31.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:31.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 79 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:31.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:31.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:31.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:31.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:32.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:32.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:32.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:32.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:33.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:33.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:33.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:33.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:34.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:34.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:34.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:34.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:35.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:35.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:35.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:35.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:36.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:36.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:36.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:36.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:37.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:37.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:37.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:37.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:38.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:38.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:38.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:38.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:39.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:39.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:39.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:39.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:40.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:40.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:40.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:40.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:41.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:41.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:41.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:41.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:42.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:42.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:42.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:42.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:43.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:43.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:43.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:43.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:44.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:44.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:44.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:44.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:45.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:45.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:45.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:45.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:46.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:46.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:46.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:46.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:47.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:47.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:47.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:47.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:48.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:48.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:48.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:48.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:49.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:49.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:49.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:49.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:50.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:50.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:50.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:50.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:51.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:51.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:51.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:51.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:52.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:52.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:52.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:52.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:53.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:53.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:53.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:53.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:54.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:54.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:54.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:54.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:55.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:55.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:55.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:55.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:56.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:56.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:56.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:56.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:57.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:57.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:58.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:58.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:58.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:58.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:59.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:26:59.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:26:59.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:26:59.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:00.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:00.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:00.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:00.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:01.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:01.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:01.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:01.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:02.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:02.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:02.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:02.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:03.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:03.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:03.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:03.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:04.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:04.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:04.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:04.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:05.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:05.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:05.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:05.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:06.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:06.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:06.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:06.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:07.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:07.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:07.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:07.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:08.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:08.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:08.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:08.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:09.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:09.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:09.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:09.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:10.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:10.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:10.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:10.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:11.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:11.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:11.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:11.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:12.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:12.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:12.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:12.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:13.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:13.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:13.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:13.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:14.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:14.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:14.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:14.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:15.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:15.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:15.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:15.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:16.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:16.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:16.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:16.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:17.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:17.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:17.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:17.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:18.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:18.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:18.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:18.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:19.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:19.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:19.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:19.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:20.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:19.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:20.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:20.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:21.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:21.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:21.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:21.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:22.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:22.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:22.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:22.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:23.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:23.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:23.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:23.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:24.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:24.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:24.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:24.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:25.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:25.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:25.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:25.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:26.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:26.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:26.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:26.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:27.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:27.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:27.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:27.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:28.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:28.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:28.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:28.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:29.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:29.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:29.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:29.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:30.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:30.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:30.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:30.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:31.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:31.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:31.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:31.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:32.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:32.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:32.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:32.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:33.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:33.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:33.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:33.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:34.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:34.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:34.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:34.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:35.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:35.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:35.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:35.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:36.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:36.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:36.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:36.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:37.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:37.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:37.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:37.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:38.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:38.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:38.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:38.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:39.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:39.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:39.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:39.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:40.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:40.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:40.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:40.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:41.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:41.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:41.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:41.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:42.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:42.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:42.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:42.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:43.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:43.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:43.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:43.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:44.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:44.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:44.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:44.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:45.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:45.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:45.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:45.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:46.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:46.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:46.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:46.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:47.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:47.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:47.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:47.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:48.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:48.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:48.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:48.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:49.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:49.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:49.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:49.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:50.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:50.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:50.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:50.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:51.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:51.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:51.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:51.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:52.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:52.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:52.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:52.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:53.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:53.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:53.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:53.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:54.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:54.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:54.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:54.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:55.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:55.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:55.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:55.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:56.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:56.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:56.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:56.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:57.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:57.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:57.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:57.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:58.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:58.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:58.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:58.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:59.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:27:59.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:27:59.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:27:59.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:00.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:00.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:00.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:00.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:01.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:01.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:01.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:01.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:02.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:02.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:02.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:02.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:03.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:03.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:03.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:03.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:04.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:04.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:04.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:04.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:05.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:05.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:05.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:05.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:06.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:06.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:06.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:06.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:07.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:07.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:07.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:07.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:08.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:08.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:08.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:08.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:09.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:09.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:09.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:09.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:10.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:10.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:10.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:10.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:11.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:11.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:11.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:11.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:12.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:12.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:12.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:12.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:13.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:13.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:13.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:13.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:14.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:14.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:14.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:14.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:15.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:15.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:15.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:15.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:16.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:16.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:16.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:16.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:17.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:17.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:17.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:17.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:18.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:18.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:18.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:18.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:19.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:19.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:19.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:19.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:20.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:20.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:20.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:20.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:21.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:21.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:21.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:21.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:22.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:22.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:22.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:22.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:23.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:23.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:23.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:23.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:24.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:24.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:24.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:24.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:25.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:25.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:25.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:25.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:26.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:26.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:26.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:26.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:27.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:27.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:27.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:27.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:28.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:28.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:28.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:28.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:29.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:29.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:29.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:29.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:30.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:30.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:30.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:30.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:31.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:31.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:31.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:31.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:32.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:32.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:32.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:32.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:33.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:33.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:33.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:33.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:34.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:34.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:34.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:34.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:35.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:35.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:35.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:35.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:36.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:36.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:36.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:36.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:37.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:37.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:37.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:37.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:38.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:38.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:38.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:38.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:39.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:39.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:39.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:39.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:40.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:40.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:40.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:40.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:41.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:41.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:41.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:41.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:42.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:42.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:42.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:42.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:43.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:43.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:43.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:43.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:44.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:44.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:44.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:44.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:45.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:45.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:45.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:45.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:46.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:46.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:46.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:46.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:47.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:47.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:47.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:47.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:48.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:48.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:48.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:48.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:49.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:49.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:49.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:49.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:50.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:50.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:50.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:50.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:51.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:51.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:51.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:51.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:52.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:52.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:52.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:52.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:53.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:53.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:53.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:53.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:54.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:54.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:54.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:54.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:55.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:55.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:55.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:55.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:56.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:56.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:56.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:56.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:57.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:57.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:57.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:57.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:58.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:58.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:58.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:58.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:59.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:28:59.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:28:59.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:28:59.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:00.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:00.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:00.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:00.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:01.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:01.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:01.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:01.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:02.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:02.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:02.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:02.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:03.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:03.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:03.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:03.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:04.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:04.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:04.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:04.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:05.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:05.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:05.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:05.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:06.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:06.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:06.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:06.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:07.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:07.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:07.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:07.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:08.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:08.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:08.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:08.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:09.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:09.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:09.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:09.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:10.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:10.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:10.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:10.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:11.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:11.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:11.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:11.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:12.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:12.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:12.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:12.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:13.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:13.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:13.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:13.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:14.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:14.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:14.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:14.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:15.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:15.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:15.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:15.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:16.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:16.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:16.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:16.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:17.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:17.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:17.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:17.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:18.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:18.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:18.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:18.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:19.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:19.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:19.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:19.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:20.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:20.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:20.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:20.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:21.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:21.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:21.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:21.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:22.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:22.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:22.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:22.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:23.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:23.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:23.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:23.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:24.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:24.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:24.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:24.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:25.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:25.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:25.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:25.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:26.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:26.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:26.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:26.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:27.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:27.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:27.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:27.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:28.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:28.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:28.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:28.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:29.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:29.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:29.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:29.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:30.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:30.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:30.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:30.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:31.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:31.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:31.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:31.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:32.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:32.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:32.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:32.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:33.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:33.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:33.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:33.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:34.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:34.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:34.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:34.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:35.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:35.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:35.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:35.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:36.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:36.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:36.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:36.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:37.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:37.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:37.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:37.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:38.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:38.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:38.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:38.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:39.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:39.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:39.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:39.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:40.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:40.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:40.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:40.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:41.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:41.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:41.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:41.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:42.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:42.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:42.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:42.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:43.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:43.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:43.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:43.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:44.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:44.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:44.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:44.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:45.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:45.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:45.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:45.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:46.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:46.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:46.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:46.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:47.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:47.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:47.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:47.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:48.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:48.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:48.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:48.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:49.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:49.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:49.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:49.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:50.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:50.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:50.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:50.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:51.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:51.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:51.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:51.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:52.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:52.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:52.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:52.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:53.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:53.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:53.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:53.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:54.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:54.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:54.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:54.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:55.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:55.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:55.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:55.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:56.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:56.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:56.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:56.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:57.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:57.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:57.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:57.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:58.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:58.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:58.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:58.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:59.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:29:59.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:29:59.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:29:59.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:00.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:00.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:00.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:00.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:01.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:01.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:01.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:01.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:02.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:02.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:02.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:02.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:03.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:03.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:03.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:03.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:04.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:04.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:04.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:04.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:05.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:05.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:05.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:05.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:06.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:06.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:06.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:06.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:07.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:07.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:07.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:07.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:08.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:08.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:08.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:08.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:09.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:09.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:09.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:09.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:10.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:10.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:10.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:10.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:11.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:11.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:11.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:11.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:12.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:12.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:12.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:12.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:13.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:13.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:13.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:13.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:14.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:14.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:14.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:14.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:15.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:15.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:15.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:15.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:16.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:16.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:16.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:16.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:17.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:17.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:17.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:17.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:18.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:18.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:18.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:18.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:19.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:19.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:19.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:19.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:20.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:20.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:20.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:20.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:21.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:21.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:21.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:21.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:22.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:22.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:22.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:22.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:23.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:23.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:23.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:23.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:24.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:24.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:24.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:24.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:25.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:25.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:25.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:25.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:26.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:26.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:26.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:26.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:27.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:27.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:27.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:27.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:28.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:28.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:28.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:28.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:29.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:29.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:29.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:29.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:30.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:30.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:30.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:30.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:31.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:31.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:31.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:31.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:32.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:32.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:32.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:32.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:33.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:33.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:33.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:33.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:34.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:34.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:34.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:34.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:35.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:35.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:35.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:35.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:36.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:36.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:36.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:36.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:37.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:37.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:37.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:37.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:38.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:38.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:38.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:38.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:39.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:39.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:39.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:39.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:40.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:40.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:40.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:40.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:41.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:41.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:41.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:41.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:42.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:42.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:42.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:42.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:43.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:43.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:43.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:43.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:44.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:44.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:44.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:44.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:45.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:45.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:45.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:45.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:46.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:46.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:46.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:46.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:47.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:47.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:47.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:47.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:48.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:48.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:48.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:48.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:49.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:49.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:49.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:49.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:50.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:50.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:50.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:50.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:51.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:51.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:51.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:51.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:52.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:52.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:52.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:52.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:53.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:53.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:53.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:53.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:54.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:54.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:54.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:54.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:55.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:55.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:55.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:55.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:56.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:56.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:56.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:56.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:57.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:57.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:57.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:57.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:58.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:58.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:58.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:58.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:59.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:30:59.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:30:59.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:30:59.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:00.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:00.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:00.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:00.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:01.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:01.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:01.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:01.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:02.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:02.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:02.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:02.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:03.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:03.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:03.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:03.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:04.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:04.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:04.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:04.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:05.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:05.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:05.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:05.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:06.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:06.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:06.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:06.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:07.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:07.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:07.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:07.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:08.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:08.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:08.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:08.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:09.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:09.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:09.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:09.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:10.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:10.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:10.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:10.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:11.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:11.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 93 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:11.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:11.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:12.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:12.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:12.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:12.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:13.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:13.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:13.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:13.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:14.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:14.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:14.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:14.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:15.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:15.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:15.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:15.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:16.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:16.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:16.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:16.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:17.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:17.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:17.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:17.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:18.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:18.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:18.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:18.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:19.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:19.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:19.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:19.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:20.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:20.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:20.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:20.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:21.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:21.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:21.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:21.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:22.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:22.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:22.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:22.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:23.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:23.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:23.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:23.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:24.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:24.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:24.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:24.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:25.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:25.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:25.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:25.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:26.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:26.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:26.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:26.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:27.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:27.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:27.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:27.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:28.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:28.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:28.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:28.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:29.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:29.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:29.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:29.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:30.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:30.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:30.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:30.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:31.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:31.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:31.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:31.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:32.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:32.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:32.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:32.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:33.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:33.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:33.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:33.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:34.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:34.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:34.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:34.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:35.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:35.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:35.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:35.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:36.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:36.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:36.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:36.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:37.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:37.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:37.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:37.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:38.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:38.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:38.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:38.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:39.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:39.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:39.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:39.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:40.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:40.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:40.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:40.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:41.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:41.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 14 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T22:31:41.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:41.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:42.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:42.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:42.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:42.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:43.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:43.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:43.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:43.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:44.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:44.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:44.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:44.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:45.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:45.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:45.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:45.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:46.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:46.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:46.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:46.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:47.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:47.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:47.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:47.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:48.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:48.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:48.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:48.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:49.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:49.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:49.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:49.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:50.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:50.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:50.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:50.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:51.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:51.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:51.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:51.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:52.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:52.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:52.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:52.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:53.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:53.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:53.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:53.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:54.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:54.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:54.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:54.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:55.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:55.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:55.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:55.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:56.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:56.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:56.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:56.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:57.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:57.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:57.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:57.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:58.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:58.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:58.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:58.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:59.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:31:59.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:31:59.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:31:59.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:00.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:00.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:00.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:00.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:01.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:01.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:01.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:01.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:02.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:02.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:02.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:02.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:03.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:03.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:03.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:03.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:04.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:04.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:04.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:04.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:05.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:05.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:05.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:05.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:06.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:06.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:06.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:06.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:07.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:07.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:07.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:07.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:08.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:08.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:08.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:08.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:09.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:09.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:09.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:09.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:10.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:10.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:10.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:10.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:11.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:11.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:11.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:11.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:12.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:12.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:12.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:12.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:13.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:13.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:13.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:13.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:14.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:14.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:14.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:14.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:15.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:15.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:15.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:15.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:16.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:16.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:16.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:16.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:17.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:17.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:17.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:17.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:18.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:18.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:18.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:18.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:19.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:19.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:19.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:19.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:20.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:20.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:20.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:20.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:21.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:21.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:21.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:21.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:22.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:22.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:22.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:22.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:23.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:23.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:23.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:23.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:24.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:24.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:24.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:24.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:25.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:25.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:25.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:25.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:26.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:26.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:26.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:26.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:27.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:27.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:27.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:27.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:28.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:28.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:28.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:28.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:29.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:29.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:29.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:29.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:30.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:30.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:30.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:30.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:31.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:31.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:31.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:31.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:32.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:32.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:32.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:32.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:33.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:33.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:33.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:33.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:34.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:34.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:34.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:34.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:35.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:35.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:35.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:35.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:36.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:36.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:36.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:36.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:37.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:37.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:37.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:37.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:38.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:38.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:38.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:38.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:39.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:39.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:39.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:39.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:40.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:40.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:40.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:40.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:41.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:41.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:41.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:41.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:42.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:42.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:42.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:42.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:43.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:43.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:43.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:43.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:44.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:44.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:44.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:44.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:45.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:45.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:45.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:45.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:46.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:46.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:46.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:46.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:47.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:47.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:47.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:47.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:48.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:48.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:48.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:48.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:49.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:49.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:49.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:49.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:50.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:50.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:50.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:50.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:51.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:51.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:51.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:51.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:52.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:52.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:52.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:52.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:53.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:53.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:53.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:53.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:54.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:54.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:54.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:54.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:55.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:55.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:55.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:55.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:56.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:56.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:56.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:56.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:57.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:57.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:57.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:57.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:58.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:58.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:58.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:58.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:59.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:32:59.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:32:59.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:32:59.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:00.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:00.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:00.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:00.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:01.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:01.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:01.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:01.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:02.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:02.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:02.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:02.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:03.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:03.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:03.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:03.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:04.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:04.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:04.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:04.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:05.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:05.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:05.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:05.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:06.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:06.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:06.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:06.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:07.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:07.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:07.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:07.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:08.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:08.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:08.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:08.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:09.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:09.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:09.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:09.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:10.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:10.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:10.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:10.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:11.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:11.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:11.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:11.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:12.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:12.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:12.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:12.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:13.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:13.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:13.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:13.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:14.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:14.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:14.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:14.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:15.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:15.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:15.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:15.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:16.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:16.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:16.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:16.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:17.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:17.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:17.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:17.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:18.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:18.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:18.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:18.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:19.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:19.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:19.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:19.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:20.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:20.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:20.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:20.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:21.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:21.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:21.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:21.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:22.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:22.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:22.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:22.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:23.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:23.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:23.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:23.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:24.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:24.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:24.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:24.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:25.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:25.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:25.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:25.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:26.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:26.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:26.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:26.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:27.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:27.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:27.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:27.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:28.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:28.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:28.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:28.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:29.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:29.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:29.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:29.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:30.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:30.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:30.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:30.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:31.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:31.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:31.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:31.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:32.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:32.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:32.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:32.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:33.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:33.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:33.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:33.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:34.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:34.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:34.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:34.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:35.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:35.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:35.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:35.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:36.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:36.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:36.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:36.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:37.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:37.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:37.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:37.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:38.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:38.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:38.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:38.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:39.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:39.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:39.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:39.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:40.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:40.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:40.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:40.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:41.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:41.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:41.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:41.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:42.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:42.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:42.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:42.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:43.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:43.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:43.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:43.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:44.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:44.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:44.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:44.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:45.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:45.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:45.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:45.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:46.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:46.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:46.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:46.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:47.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:47.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:47.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:47.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:48.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:48.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:48.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:48.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:49.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:49.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:49.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:49.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:50.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:50.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:50.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:50.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:51.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:51.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:51.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:51.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:52.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:52.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:52.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:52.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:53.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:53.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:53.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:53.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:54.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:54.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:54.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:54.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:55.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:55.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:55.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:55.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:56.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:56.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:56.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:56.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:57.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:57.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:57.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:57.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:58.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:58.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:58.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:58.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:59.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:33:59.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:33:59.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:33:59.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:00.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:00.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:00.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:00.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:01.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:01.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:01.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:01.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:02.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:02.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:02.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:02.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:03.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:03.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:03.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:03.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:04.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:04.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:04.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:04.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:05.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:05.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:05.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:05.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:06.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:06.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:06.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:06.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:07.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:07.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:07.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:07.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:08.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:08.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:08.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:08.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:09.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:09.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:09.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:09.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:10.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:10.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:10.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:10.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:11.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:11.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:11.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:11.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:12.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:12.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:12.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:12.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:13.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:13.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:13.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:13.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:14.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:14.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:14.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:14.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:15.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:15.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:15.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:15.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:16.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:16.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:16.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:16.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:17.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:17.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:17.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:17.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:18.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:18.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:18.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:18.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:19.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:19.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:19.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:19.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:20.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:20.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:20.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:20.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:21.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:21.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:21.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:21.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:22.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:22.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:22.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:22.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:23.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:23.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:23.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:23.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:24.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:24.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:24.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:24.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:25.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:25.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:25.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:25.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:25.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:25.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:26.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:26.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:27.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:27.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:27.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:27.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:27.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:27.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:28.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:28.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:28.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:28.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:29.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:29.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:29.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:29.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:30.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:30.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:30.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:30.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:31.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:31.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:32.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:32.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:32.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:32.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:32.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:32.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:33.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:33.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:33.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:33.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:34.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:34.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:34.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:34.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:35.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:35.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:35.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:35.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:36.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:36.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:36.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:36.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:37.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:37.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:38.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:38.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:38.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:38.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:39.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:39.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:39.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:39.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:40.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:40.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:40.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:40.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:40.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:40.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:41.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:41.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:42.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:42.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:42.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:42.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:43.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:42.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:43.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:43.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:44.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:44.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:44.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:44.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:45.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:45.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:45.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:45.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:46.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:46.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:46.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:46.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:47.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:47.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:47.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:47.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:48.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:48.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:48.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:48.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:49.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:49.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:49.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:49.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:50.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:50.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:50.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:50.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:51.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:51.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:51.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:51.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:52.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:52.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:52.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:52.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:53.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:53.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:53.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:53.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:54.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:54.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:54.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:54.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:55.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:55.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:55.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:55.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:56.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:56.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:56.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:56.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:57.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:57.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:57.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:57.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:58.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:58.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:58.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:58.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:59.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:34:59.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:34:59.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:34:59.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:00.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:00.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:00.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:00.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:01.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:01.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:01.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:01.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:02.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:02.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:02.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:02.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:03.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:03.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:03.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:03.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:04.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:04.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:04.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:04.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:05.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:05.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:05.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:05.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:06.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:06.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:06.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:06.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:07.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:07.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:07.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:07.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:08.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:08.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:08.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:08.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:09.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:09.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:09.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:09.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:10.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:10.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:10.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:10.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:11.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:10.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:11.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:11.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:11.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:11.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:12.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:12.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:12.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:12.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:13.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:13.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:13.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:13.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:14.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:14.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:14.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:14.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:15.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:15.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:15.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:15.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:16.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:16.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:16.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:16.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:17.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:17.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:17.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:17.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:18.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:18.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:18.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:18.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:19.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:19.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:19.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:19.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:20.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:20.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:20.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:20.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:21.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:21.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:21.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:21.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:22.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:22.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:23.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:23.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:23.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:23.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:24.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:24.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:24.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:24.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:25.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:25.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:25.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:25.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:26.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:26.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:26.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:26.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:27.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:27.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:27.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:27.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:28.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:28.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:28.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:28.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:29.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:29.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:29.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:29.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:30.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:30.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:30.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:30.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:31.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:31.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:31.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:31.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:32.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:32.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:32.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:32.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:33.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:33.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:33.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:33.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:34.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:34.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:34.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:34.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:35.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:35.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:35.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:35.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:36.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:36.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:36.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:36.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:37.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:37.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:37.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:37.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:38.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:38.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:38.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:38.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:39.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:38.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:39.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:39.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:39.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:39.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:40.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:40.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:40.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:40.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:41.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:41.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:41.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:41.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:42.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:42.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:43.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:43.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:43.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:43.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:43.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:43.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:44.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:44.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:44.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:44.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:45.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:45.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:45.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:45.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:46.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:46.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:47.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:46.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:47.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:47.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:47.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:47.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:48.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:48.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:48.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:48.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:49.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:49.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:49.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:49.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:50.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:50.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:50.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:50.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:51.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:51.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:51.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:51.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:52.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:52.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:52.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:52.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:53.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:53.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:53.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:53.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:54.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:54.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:54.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:54.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:55.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:55.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:55.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:55.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:56.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:56.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:56.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:56.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:57.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:57.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:57.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:57.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:58.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:58.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:35:59.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:35:59.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:00.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:35:59.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:00.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:00.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:01.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:01.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:01.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:01.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:02.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:02.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:02.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:02.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:02.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:02.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:03.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:03.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:03.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:03.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:04.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:04.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:04.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:04.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:04.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:04.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:05.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:05.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:05.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:05.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:06.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:06.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:06.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:06.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:07.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:07.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:07.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:07.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:08.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:08.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:08.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:08.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:09.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:09.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:09.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:09.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:10.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:10.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:11.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:11.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:11.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:11.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:12.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:12.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:12.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:12.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:13.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:13.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:13.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:13.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:14.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:14.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:14.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:14.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:15.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:15.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:15.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:15.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:16.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:16.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:16.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:16.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:17.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:17.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:17.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:17.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:18.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:18.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:18.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:18.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:19.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:19.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:20.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:20.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:20.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:20.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:20.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:20.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:21.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:21.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:22.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:22.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:22.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:22.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:23.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:23.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:23.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:23.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:24.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:24.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:24.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:24.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:25.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:25.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:25.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:25.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:26.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:26.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:26.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:26.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:27.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:27.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:27.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:27.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:28.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:28.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:28.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:28.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:29.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:29.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:29.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:29.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:30.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:30.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:30.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:30.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:31.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:31.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:31.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:31.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:32.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:32.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:32.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:32.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:33.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:33.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:33.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:33.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:34.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:34.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:34.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:34.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:35.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:35.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:35.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:35.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:36.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:36.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:36.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:36.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:37.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:37.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:37.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:37.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:38.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:38.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:38.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:38.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:39.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:39.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:39.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:39.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:40.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:40.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:40.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:40.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:41.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:41.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:41.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:41.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:42.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:42.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:42.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:42.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:43.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:43.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:43.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:43.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:44.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:44.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:44.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:44.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:45.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:45.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:45.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:45.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:46.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:46.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:46.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:46.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:47.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:47.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:47.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:47.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:48.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:48.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:48.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:48.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:49.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:49.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:49.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:49.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:50.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:50.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:50.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:50.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:51.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:51.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:51.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:51.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:52.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:52.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:52.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:52.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:53.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:53.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:53.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:53.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:54.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:54.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:54.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:54.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:55.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:55.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:55.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:55.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:55.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:55.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:56.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:56.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:56.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:56.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:57.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:57.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:57.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:57.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:58.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:58.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:58.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:58.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:59.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:36:59.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:36:59.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:36:59.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:00.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:00.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:00.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:00.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:01.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:01.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:01.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:01.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:02.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:02.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:02.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:02.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:03.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:03.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:03.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:03.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:04.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:04.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:04.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:04.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:05.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:05.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:05.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:05.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:06.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:06.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:06.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:06.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:07.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:07.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:07.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:07.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:08.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:08.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:08.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:08.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:09.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:09.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:09.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:09.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:10.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:10.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:10.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:10.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:10.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:10.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:11.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:11.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:11.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:11.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:12.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:12.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:12.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:12.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:13.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:13.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:14.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:14.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:14.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:14.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:15.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:15.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:15.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:15.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:16.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:16.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:16.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:16.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:17.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:17.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:17.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:17.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:18.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:18.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:18.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:18.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:19.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:19.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:19.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:19.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:20.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:20.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:20.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:20.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:21.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:21.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:21.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:21.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:22.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:22.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:22.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:22.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:23.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:23.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:23.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:23.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:24.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:24.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:24.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:24.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:25.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:25.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:25.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:25.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:26.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:26.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:26.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:26.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:27.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:27.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:27.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:27.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:28.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:28.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:28.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:28.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:29.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:29.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:29.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:29.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:30.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:30.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:30.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:30.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:31.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:31.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:31.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:31.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:32.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:32.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:32.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:32.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:33.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:33.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:33.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:33.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:34.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:34.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:34.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:34.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:35.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:35.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:35.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:35.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:36.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:36.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:36.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:36.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:37.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:37.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:37.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:37.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:38.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:38.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:38.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:38.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:39.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:39.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:39.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:39.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:40.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:40.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:40.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:40.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:41.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:41.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:41.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:41.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:42.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:42.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:42.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:42.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:43.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:43.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:43.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:43.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:44.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:44.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:44.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:44.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:45.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:45.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:45.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:45.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:46.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:46.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:46.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:46.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:47.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:47.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:47.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:47.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:48.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:48.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:48.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:48.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:49.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:49.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:49.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:49.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:50.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:50.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:50.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:50.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:51.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:51.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:51.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:51.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:52.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:52.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:52.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:52.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:53.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:53.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:53.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:53.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:54.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:54.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:54.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:54.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:55.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:55.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:55.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:55.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:56.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:56.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:56.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:56.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:57.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:57.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:57.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:57.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:58.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:58.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:58.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:58.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:59.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:37:59.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:37:59.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:37:59.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:00.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:00.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:00.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:00.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:01.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:01.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:01.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:01.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:02.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:02.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:02.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:02.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:03.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:03.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:03.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:03.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:04.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:04.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:04.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:04.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:05.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:05.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:05.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:05.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:06.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:06.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:06.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:06.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:06.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:06.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:07.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:07.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:07.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:07.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:08.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:08.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:08.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:08.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:09.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:09.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:09.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:09.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:10.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:10.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:10.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:10.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:11.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:11.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:11.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:11.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:12.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:12.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:12.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:12.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:13.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:13.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:13.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:13.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:14.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:14.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:14.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:14.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:15.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:15.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:16.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:16.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:16.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:16.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:17.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:17.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:17.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:17.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:18.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:18.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:18.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:18.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:19.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:19.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:19.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:19.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:20.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:20.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:20.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:20.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:21.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:21.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:21.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:21.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:22.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:22.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:22.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:22.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:23.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:23.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:23.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:23.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:23.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:23.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:24.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:24.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:25.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:24.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:25.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:25.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:25.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:25.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:26.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:26.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:26.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:26.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:27.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:27.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:27.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:27.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:28.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:28.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:28.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:28.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:29.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:29.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:29.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:29.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:30.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:30.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:30.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:30.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:31.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:31.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:31.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:31.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:32.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:32.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:32.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:32.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:33.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:33.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:34.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:34.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:34.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:34.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:34.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:34.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:35.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:35.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:35.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:35.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:36.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:36.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:36.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:36.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:37.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:37.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:37.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:37.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:38.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:38.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:38.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:38.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:39.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:39.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:39.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:39.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:40.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:40.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:40.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:40.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:41.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:41.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:41.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:41.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:42.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:42.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:42.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:42.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:43.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:43.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:43.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:43.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:44.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:44.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:44.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:44.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:45.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:45.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:45.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:45.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:46.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:46.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:46.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:46.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:47.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:47.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:47.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:47.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:48.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:48.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:48.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:48.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:49.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:49.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:49.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:49.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:50.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:50.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:50.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:50.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:51.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:51.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:51.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:51.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:52.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:52.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:52.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:52.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:53.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:53.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:53.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:53.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:54.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:54.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:54.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:54.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:55.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:55.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:55.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:55.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:56.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:56.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:56.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:56.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:57.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:57.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:57.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:57.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:58.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:58.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:58.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:58.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:59.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:38:59.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:38:59.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:38:59.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:00.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:00.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:00.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:00.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:01.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:01.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:01.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:01.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:02.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:02.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:02.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:02.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:03.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:03.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:03.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:03.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:04.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:04.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:04.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:04.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:05.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:05.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:05.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:05.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:06.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:06.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:06.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:06.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:07.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:07.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:07.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:07.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:08.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:08.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:08.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:08.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:09.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:09.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:09.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:09.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:10.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:10.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:10.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:10.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:11.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:11.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:11.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:11.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:12.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:12.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:12.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:12.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:13.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:13.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:13.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:13.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:14.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:14.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:14.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:14.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:15.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:15.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:15.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:15.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:16.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:16.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:16.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:16.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:17.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:17.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:17.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:17.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:18.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:18.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:18.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:18.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:19.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:19.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:19.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:19.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:20.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:20.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:20.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:20.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:21.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:21.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:21.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:21.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:22.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:22.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:22.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:22.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:23.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:23.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:23.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:23.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:24.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:24.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:24.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:24.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:25.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:25.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:25.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:25.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:26.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:26.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:26.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:26.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:27.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:27.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:27.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:27.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:28.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:28.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:28.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:28.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:29.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:29.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:29.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:29.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:30.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:30.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:30.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:30.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:31.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:31.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:31.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:31.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:32.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:32.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:32.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:32.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:33.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:33.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:33.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:33.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:34.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:34.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:34.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:34.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:35.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:35.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:35.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:35.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:36.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:36.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:36.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:36.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:37.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:37.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:37.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:37.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:38.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:38.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:38.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:38.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:39.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:39.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:39.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:39.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:40.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:40.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:40.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:40.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:41.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:41.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:41.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:41.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:42.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:42.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:42.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:42.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:43.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:43.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:43.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:43.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:44.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:44.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:44.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:44.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:45.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:45.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:45.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:45.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:46.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:46.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:46.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:46.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:47.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:47.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:48.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:47.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:48.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:48.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:48.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:48.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:49.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:49.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:49.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:49.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:50.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:50.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:50.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:50.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:51.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:51.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:52.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:51.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:52.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:52.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:53.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:53.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:53.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:53.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:54.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:54.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:54.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:54.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:55.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:55.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:55.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:55.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:56.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:56.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:56.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:56.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:57.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:57.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:57.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:57.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:57.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:57.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:58.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:58.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:58.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:58.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:59.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:39:59.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:39:59.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:39:59.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:00.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:00.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:00.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:00.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:01.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:01.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:01.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:01.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:02.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:02.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:02.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:02.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:03.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:03.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:03.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:03.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:04.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:04.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:04.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:04.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:05.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:05.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:05.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:05.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:06.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:06.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:06.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:06.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:07.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:07.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:07.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:07.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:08.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:08.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:08.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:08.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:09.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:09.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:09.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:09.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:10.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:10.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:10.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:10.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:11.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:11.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:11.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:11.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:12.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:12.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:12.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:12.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:13.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:13.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:13.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:13.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:14.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:14.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:15.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:14.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:15.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:15.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:16.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:16.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:16.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:16.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:17.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:17.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:17.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:17.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:18.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:18.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:18.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:18.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:19.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:19.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:19.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:19.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:20.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:20.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:20.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:20.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:21.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:21.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:21.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:21.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:22.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:22.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:22.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:22.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:23.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:23.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:23.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:23.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:24.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:24.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:24.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:24.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:25.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:25.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:26.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:26.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:26.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:26.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:27.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:27.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:27.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:27.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:27.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:27.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:28.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:28.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:28.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:28.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:29.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:29.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:29.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:29.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:30.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:30.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:31.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:31.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:31.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:31.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:31.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:31.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:32.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:32.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:32.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:32.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:33.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:33.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:33.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:33.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:34.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:34.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:35.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:34.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:35.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:34.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:35.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:35.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:36.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:36.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:37.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:37.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:37.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:37.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:38.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:38.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:38.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:38.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:39.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:39.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:39.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:39.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:40.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:39.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:40.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:40.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:40.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:40.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:41.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:41.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:42.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:42.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:42.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:42.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:43.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:42.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:43.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:43.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:44.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:44.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:44.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:44.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:45.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:44.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:45.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:45.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:46.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:46.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:46.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:46.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:47.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:47.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:47.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:47.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:48.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:48.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:48.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:48.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:49.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:49.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:49.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:49.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:50.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:50.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:50.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:50.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:51.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:51.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:51.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:51.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:52.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:52.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:52.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:52.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:53.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:53.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:53.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:53.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:54.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:54.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:54.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:54.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:55.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:55.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:55.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:55.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:56.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:56.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:56.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:56.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:57.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:57.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:57.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:57.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:58.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:58.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:58.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:58.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:59.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:40:59.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:40:59.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:40:59.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:00.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:00.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:00.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:00.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:01.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:01.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:01.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:01.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:01.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:01.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:02.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:02.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:02.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:02.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:03.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:03.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:03.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:03.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:04.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:04.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:04.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:04.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:05.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:05.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:05.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:05.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:06.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:06.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:06.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:06.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:07.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:06.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:07.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:07.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:08.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:07.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:08.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:08.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:08.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:08.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:09.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:09.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:09.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:09.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:10.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:10.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:10.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:10.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:11.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:11.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:11.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:11.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:12.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:12.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:12.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:12.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:13.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:13.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:13.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:13.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:14.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:14.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:15.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:14.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:15.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:15.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:16.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:16.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:16.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:16.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:16.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:16.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:17.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:17.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:18.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:18.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:18.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:18.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:19.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:19.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:19.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:19.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:20.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:20.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:20.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:20.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:21.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:21.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:21.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:21.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:22.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:22.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:22.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:22.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:23.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:23.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:23.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:23.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:24.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:24.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:24.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:24.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:25.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:25.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:25.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:25.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:26.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:26.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:26.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:26.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:27.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:27.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:27.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:27.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:28.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:28.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:28.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:28.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:29.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:29.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:29.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:29.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:30.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:30.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:30.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:30.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:31.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:31.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:31.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:31.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:32.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:32.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:32.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:32.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:33.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:33.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:33.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:33.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:34.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:34.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:34.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:34.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:35.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:35.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:35.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:35.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:36.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:36.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:36.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:36.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:37.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:37.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:37.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:37.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:38.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:38.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:38.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:38.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:39.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:39.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:39.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:39.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:40.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:40.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:40.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:40.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:41.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:41.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:41.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:41.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:42.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:42.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:42.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:42.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:43.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:43.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:43.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:43.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:44.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:44.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:44.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:44.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:45.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:45.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:45.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:45.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:46.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:46.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:46.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:46.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:47.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:47.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:47.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:47.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:48.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:48.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:49.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:49.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:49.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:49.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:49.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:49.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:50.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:50.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:51.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:51.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:51.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:51.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:51.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:51.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:52.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:52.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:53.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:52.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:53.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:53.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:53.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:53.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:54.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:54.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:54.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:54.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:55.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:55.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:55.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:55.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:56.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:56.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:56.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:56.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:57.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:57.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:57.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:57.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:58.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:58.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:58.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:58.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:59.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:41:59.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:41:59.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:41:59.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:00.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:00.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:00.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:00.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:01.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:01.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:01.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:01.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:02.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:02.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:03.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:03.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:03.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:03.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:03.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:03.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:04.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:04.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:05.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:05.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:05.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:05.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:06.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:06.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:06.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:06.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:07.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:07.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:07.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:07.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:08.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:08.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:08.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:08.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:09.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:09.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:09.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:09.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:10.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:10.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:10.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:10.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:11.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:11.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:11.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:11.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:12.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:12.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:12.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:12.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:13.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:13.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:13.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:13.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:14.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:14.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:14.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:14.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:15.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:15.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:15.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:15.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:16.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:16.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:16.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:16.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:17.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:17.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:17.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:17.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:18.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:18.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:18.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:18.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:19.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:19.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:19.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:19.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:20.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:20.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:20.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:20.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:21.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:21.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:21.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:21.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:22.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:21.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:22.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:22.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:22.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:22.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:23.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:23.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:23.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:23.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:24.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:24.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:24.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:24.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:25.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:25.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:25.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:25.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:26.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:26.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:26.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:26.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:27.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:27.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:27.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:27.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:28.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:28.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:28.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:28.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:29.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:29.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:29.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:29.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:30.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:30.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:30.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:30.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:31.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:31.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:31.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:31.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:32.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:32.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:32.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:32.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:33.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:33.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:33.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:33.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:34.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:34.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:34.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:34.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:35.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:35.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:35.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:35.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:36.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:36.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:36.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:36.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:37.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:37.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:37.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:37.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:38.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:38.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:38.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:38.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:39.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:39.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:39.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:39.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:40.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:40.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:40.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:40.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:41.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:41.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:41.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:41.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:42.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:42.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:42.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:42.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:43.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:43.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:43.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:43.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:44.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:44.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:44.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:44.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:45.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:45.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:45.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:45.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:46.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:46.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:46.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:46.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:47.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:47.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:47.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:47.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:48.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:48.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:48.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:48.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:49.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:49.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:49.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:49.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:50.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:50.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:50.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:50.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:51.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:51.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:51.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:51.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:52.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:52.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:52.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:52.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:53.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:53.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:53.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:53.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:54.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:54.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:54.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:54.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:55.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:55.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:55.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:55.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:56.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:56.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:56.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:56.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:57.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:57.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:57.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:57.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:58.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:58.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:58.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:58.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:59.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:58.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:59.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:42:59.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:42:59.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:42:59.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:00.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:00.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:00.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:00.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:01.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:01.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:02.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:02.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:03.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:03.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:03.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:03.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:04.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:04.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:04.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:04.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:05.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:05.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:05.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:05.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:06.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:06.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:06.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:06.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:07.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:07.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:07.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:07.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:08.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:08.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:08.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:08.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:09.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:09.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:09.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:09.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:10.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:10.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:10.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:10.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:10.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:10.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:11.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:11.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:12.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:12.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:12.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:12.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:13.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:13.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:13.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:13.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:14.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:14.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:14.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:14.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:15.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:15.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:15.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:15.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:16.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:16.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:16.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:16.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:17.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:17.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:17.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:17.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:18.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:18.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:18.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:18.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:19.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:19.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:19.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:19.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:20.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:20.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:20.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:20.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:21.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:21.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:21.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:21.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:22.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:22.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:22.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:22.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:23.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:23.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:23.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:23.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:24.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:24.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:24.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:24.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:25.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:25.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:25.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:25.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:26.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:26.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:26.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:26.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:27.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:27.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:27.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:27.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:28.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:28.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:28.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:28.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:29.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:29.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:29.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:29.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:30.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:30.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:30.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:30.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:31.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:31.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:31.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:31.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:32.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:32.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:32.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:32.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:33.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:33.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:33.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:33.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:34.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:34.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:34.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:34.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:35.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:35.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:35.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:35.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:36.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:36.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:36.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:36.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:37.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:37.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:37.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:37.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:38.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:38.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:38.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:38.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:39.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:39.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:39.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:39.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:40.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:40.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:40.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:40.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:41.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:41.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:41.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:41.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:42.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:42.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:42.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:42.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:43.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:43.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:43.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:43.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:44.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:44.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:44.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:44.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:45.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:45.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:45.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:45.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:46.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:46.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:46.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:46.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:47.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:47.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:47.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:47.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:48.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:48.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:48.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:48.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:49.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:49.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:49.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:49.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:50.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:50.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:50.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:50.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:51.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:51.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:51.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:51.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:52.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:52.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:52.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:52.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:53.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:53.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:53.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:53.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:54.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:54.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:54.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:54.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:55.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:55.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:55.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:55.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:56.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:56.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:56.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:56.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:57.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:57.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:57.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:57.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:58.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:58.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:58.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:58.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:59.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:43:59.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:43:59.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:43:59.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:00.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:00.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:00.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:00.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:01.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:01.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:01.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:01.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:02.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:02.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:02.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:02.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:03.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:03.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:03.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:03.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:04.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:04.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:04.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:04.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:05.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:05.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:05.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:05.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:06.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:06.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:06.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:06.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:07.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:07.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:07.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:07.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:08.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:08.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:08.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:08.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:09.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:09.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:09.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:09.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:10.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:10.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:10.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:10.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:11.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:11.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:11.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:11.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:12.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:12.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:12.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:12.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:13.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:13.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:13.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:13.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:14.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:14.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:14.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:14.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:15.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:15.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:15.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:15.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:16.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:16.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:16.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:16.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:17.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:17.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:17.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:17.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:18.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:18.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:18.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:18.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:19.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:19.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:19.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:19.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:20.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:20.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:20.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:20.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:21.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:21.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:21.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:21.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:22.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:22.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:22.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:22.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:23.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:23.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:23.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:23.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:24.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:24.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:24.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:24.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:25.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:25.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:25.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:25.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:26.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:26.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:26.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:26.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:27.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:27.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:27.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:27.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:28.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:28.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:28.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:28.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:29.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:29.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:29.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:29.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:30.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:30.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:30.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:30.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:31.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:31.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:31.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:31.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:32.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:32.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:32.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:32.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:33.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:33.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:33.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:33.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:34.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:34.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:34.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:34.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:35.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:35.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:35.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:35.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:36.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:36.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:36.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:36.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:37.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:37.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:37.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:37.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:38.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:38.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:38.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:38.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:39.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:39.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:39.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:39.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:40.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:40.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:40.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:40.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:41.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:41.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:41.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:41.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:42.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:42.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:42.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:42.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:43.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:43.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:43.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:43.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:44.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:44.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:44.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:44.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:45.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:45.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:45.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:45.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:46.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:46.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:46.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:46.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:47.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:47.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:47.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:47.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:48.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:48.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:48.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:48.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:49.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:49.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:49.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:49.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:50.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:50.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:50.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:50.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:51.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:51.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:51.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:51.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:52.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:52.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:52.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:52.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:53.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:53.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:53.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:53.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:54.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:54.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:54.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:54.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:55.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:55.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:55.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:55.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:56.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:56.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:56.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:56.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:57.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:57.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:57.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:57.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:58.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:58.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:58.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:58.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:59.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:44:59.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:44:59.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:44:59.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:00.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:00.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:00.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:00.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:01.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:01.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:01.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:01.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:02.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:02.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:02.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:02.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:03.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:03.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:03.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:03.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:04.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:04.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:04.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:04.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:05.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:05.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:05.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:05.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:06.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:06.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:06.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:06.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:07.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:07.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:07.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:07.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:08.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:08.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:08.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:08.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:09.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:09.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:09.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:09.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:10.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:10.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:10.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:10.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:11.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:11.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:11.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:11.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:12.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:12.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:12.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:12.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:13.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:13.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:13.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:13.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:14.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:14.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:14.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:14.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:15.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:15.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:15.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:15.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:16.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:16.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:16.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:16.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:17.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:17.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:17.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:17.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:18.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:18.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:18.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:18.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:19.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:19.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:19.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:19.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:20.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:20.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:20.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:20.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:21.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:21.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:21.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:21.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:22.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:22.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:22.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:22.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:23.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:23.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:23.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:23.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:24.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:24.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:24.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:24.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:25.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:25.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:25.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:25.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:26.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:26.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:26.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:26.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:27.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:27.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:27.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:27.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:28.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:28.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:28.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:28.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:29.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:29.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:29.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:29.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:30.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:30.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:30.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:30.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:31.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:31.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:31.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:31.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:32.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:32.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:32.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:32.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:33.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:33.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:33.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:33.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:34.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:34.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:34.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:34.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:35.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:35.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:35.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:35.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:36.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:36.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:36.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:36.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:37.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:37.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:37.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:37.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:38.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:38.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:38.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:38.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:39.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:39.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:39.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:39.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:40.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:40.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:40.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:40.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:41.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:41.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:41.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:41.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:42.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:42.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:42.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:42.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:43.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:43.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:43.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:43.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:44.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:44.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:44.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:44.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:45.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:45.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:45.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:45.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:46.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:46.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:46.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:46.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:47.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:47.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:47.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:47.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:48.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:48.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:48.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:48.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:49.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:49.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:49.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:49.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:50.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:50.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:50.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:50.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:51.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:51.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:51.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:51.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:52.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:52.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:52.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:52.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:53.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:53.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:53.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:53.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:54.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:54.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:54.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:54.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:55.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:55.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:55.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:55.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:56.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:56.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:56.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:56.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:57.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:57.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:57.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:57.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:58.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:58.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:58.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:58.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:59.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:45:59.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:45:59.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:45:59.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:00.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:00.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:00.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:00.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:01.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:01.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:01.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:01.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:02.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:02.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:02.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:02.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:03.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:03.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:03.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:03.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:04.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:04.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:04.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:04.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:05.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:05.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:05.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:05.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:06.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:06.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:06.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:06.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:07.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:07.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:07.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:07.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:08.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:08.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:08.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:08.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:09.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:09.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:09.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:09.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:10.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:10.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:10.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:10.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:11.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:11.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 96 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:11.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:11.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:12.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:12.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:12.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:12.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:13.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:13.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:13.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:13.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:14.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:14.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:14.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:14.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:15.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:15.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:15.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:15.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:16.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:16.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:16.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:16.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:17.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:17.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:17.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:17.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:18.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:18.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:18.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:18.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:19.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:19.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:19.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:19.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:20.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:20.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:20.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:20.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:21.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:21.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:21.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:21.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:22.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:22.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:22.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:22.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:23.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:23.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:23.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:23.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:24.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:24.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:24.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:24.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:25.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:25.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:25.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:25.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:26.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:26.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:26.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:26.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:27.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:27.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:27.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:27.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:28.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:28.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:28.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:28.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:29.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:29.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:29.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:29.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:30.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:30.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:30.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:30.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:31.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:31.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:31.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:31.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:32.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:32.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:32.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:32.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:33.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:33.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:33.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:33.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:34.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:34.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:34.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:34.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:35.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:35.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:35.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:35.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:36.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:36.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:36.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:36.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:37.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:37.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:37.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:37.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:38.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:38.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:38.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:38.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:39.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:39.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:39.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:39.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:40.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:40.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:40.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:40.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:41.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:41.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 67 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:41.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:41.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:42.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:42.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:42.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:42.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:43.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:43.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:43.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:43.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:44.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:44.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:44.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:44.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:45.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:45.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:45.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:45.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:46.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:46.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:46.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:46.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:47.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:47.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:47.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:47.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:48.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:48.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:48.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:48.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:49.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:49.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:49.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:49.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:50.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:50.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:50.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:50.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:51.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:51.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:51.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:51.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:52.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:52.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:52.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:52.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:53.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:53.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:53.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:53.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:54.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:54.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:54.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:54.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:55.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:55.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:55.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:55.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:56.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:56.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:56.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:56.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:57.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:57.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:57.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:57.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:58.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:58.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:58.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:58.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:59.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:46:59.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:46:59.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:46:59.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:00.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:00.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:00.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:00.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:01.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:01.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:01.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:01.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:02.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:02.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:02.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:02.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:03.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:03.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:03.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:03.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:04.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:04.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:04.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:04.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:05.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:05.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:05.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:05.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:06.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:06.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:06.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:06.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:07.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:07.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:07.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:07.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:08.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:08.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:08.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:08.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:09.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:09.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:09.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:09.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:10.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:10.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:10.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:10.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:11.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:11.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:11.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:11.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:12.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:12.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:12.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:12.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:13.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:13.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:13.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:13.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:14.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:14.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:14.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:14.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:15.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:15.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:15.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:15.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:16.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:16.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:16.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:16.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:17.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:17.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:17.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:17.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:18.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:18.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:18.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:18.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:19.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:19.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:19.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:19.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:20.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:20.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:20.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:20.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:21.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:21.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:21.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:21.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:22.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:22.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:22.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:22.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:23.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:23.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:23.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:23.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:24.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:24.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:24.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:24.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:25.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:25.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:25.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:25.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:26.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:26.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:26.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:26.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:27.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:27.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:27.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:27.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:28.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:28.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:28.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:28.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:29.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:29.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:29.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:29.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:30.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:30.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:30.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:30.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:31.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:31.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:31.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:31.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:32.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:32.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:32.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:32.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:33.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:33.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:33.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:33.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:34.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:34.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:34.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:34.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:35.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:35.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:35.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:35.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:36.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:36.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:36.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:36.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:37.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:37.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:37.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:37.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:38.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:38.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:38.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:38.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:39.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:39.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:39.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:39.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:40.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:40.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:40.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:40.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:41.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:41.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:41.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:41.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:42.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:42.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:42.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:42.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:43.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:43.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:43.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:43.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:44.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:44.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:44.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:44.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:45.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:45.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:45.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:45.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:46.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:46.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:46.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:46.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:47.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:47.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:47.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:47.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:48.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:48.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:48.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:48.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:49.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:49.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:49.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:49.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:50.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:50.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:50.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:50.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:51.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:51.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:51.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:51.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:52.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:52.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:52.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:52.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:53.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:53.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:53.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:53.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:54.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:54.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:54.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:54.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:55.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:55.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:55.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:55.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:56.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:56.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:56.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:56.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:57.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:57.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:57.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:57.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:58.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:58.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:58.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:58.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:59.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:47:59.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:47:59.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:47:59.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:00.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:00.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:00.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:00.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:01.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:01.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:01.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:01.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:02.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:02.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:02.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:02.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:03.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:03.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:03.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:03.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:04.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:04.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:04.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:04.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:05.412 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T22:48:05.406+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac14ca60 msgr2=0x7f81ac108790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T22:48:05.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:05.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:05.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:05.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:06.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:06.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:06.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:06.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:07.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:07.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:07.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:07.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:08.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:08.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:08.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:08.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:09.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:09.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:09.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:09.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:10.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:10.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:10.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:10.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:11.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:11.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:11.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:11.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:12.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:12.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:12.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:12.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:13.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:13.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:13.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:13.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:14.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:14.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:14.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:14.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:15.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:15.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:15.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:15.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:16.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:16.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:16.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:16.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:17.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:17.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:17.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:17.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:18.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:18.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:18.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:18.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:19.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:19.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:19.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:19.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:20.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:20.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:21.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:21.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:21.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:21.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:22.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:22.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:22.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:22.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:22.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:22.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:24.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:23.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:24.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:24.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:24.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:24.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:24.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:24.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:25.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:25.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:25.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:25.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:26.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:26.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:26.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:26.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:27.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:27.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:27.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:27.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:28.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:28.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:28.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:28.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:29.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:29.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:29.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:29.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:30.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:30.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:30.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:30.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:31.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:31.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:31.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:31.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:32.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:32.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:32.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:32.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:33.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:33.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:33.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:33.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:34.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:34.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:34.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:34.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:35.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:35.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:35.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:35.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:36.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:36.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:36.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:36.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:37.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:37.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:37.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:37.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:38.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:38.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:38.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:38.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:39.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:39.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:40.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:40.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:40.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:40.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:41.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:41.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:41.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:41.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:42.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:42.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:42.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:42.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:43.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:43.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:43.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:43.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:44.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:44.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:44.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:44.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:45.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:45.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:45.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:45.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:46.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:46.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:46.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:46.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:47.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:47.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:47.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:47.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:48.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:48.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:48.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:48.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:49.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:48.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:49.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:49.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:50.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:50.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:50.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:50.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:51.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:51.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:51.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:51.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:52.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:52.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:52.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:52.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:53.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:53.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:53.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:53.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:54.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:54.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:54.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:54.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:54.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:54.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:55.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:55.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:55.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:55.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:56.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:56.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:56.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:56.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:57.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:57.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:58.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:58.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:58.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:58.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:59.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:59.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:59.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:48:59.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:48:59.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:48:59.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:00.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:00.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:00.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:00.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:01.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:01.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:01.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:01.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:02.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:02.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:02.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:02.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:03.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:03.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:03.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:03.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:04.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:04.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:04.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:04.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:05.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:05.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:05.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:05.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:06.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:06.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:06.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:06.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:07.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:07.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:07.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:07.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:08.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:08.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:08.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:08.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:09.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:09.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:09.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:09.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:10.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:10.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:10.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:10.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:11.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:11.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:11.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:11.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:12.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:12.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:12.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:12.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:13.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:13.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:13.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:13.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:14.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:14.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:14.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:14.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:15.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:15.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:15.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:15.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:16.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:16.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:16.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:16.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:17.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:17.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:17.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:17.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:18.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:18.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:18.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:18.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:19.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:19.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:19.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:19.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:20.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:20.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:20.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:20.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:21.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:21.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:21.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:21.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:22.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:22.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:22.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:22.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:23.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:23.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:23.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:23.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:24.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:24.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:24.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:24.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:25.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:25.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:25.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:25.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:26.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:26.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:26.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:26.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:27.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:27.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:28.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:27.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:28.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:28.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:29.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:29.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:29.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:29.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:29.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:29.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:30.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:30.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:30.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:30.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:31.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:31.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:32.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:32.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:32.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:32.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:33.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:33.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:33.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:33.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:34.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:34.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:34.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:34.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:34.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:34.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:35.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:35.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:35.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:35.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:36.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:36.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:37.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:37.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:37.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:37.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:38.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:38.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:38.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:38.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:38.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:38.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:40.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:40.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:40.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:40.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:40.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:40.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:41.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:41.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:41.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:41.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:42.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:42.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:42.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:42.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:43.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:43.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:43.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:43.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:43.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:43.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:44.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:44.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:44.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:44.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:46.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:46.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:46.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:46.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:46.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:46.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:47.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:46.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:47.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:47.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:48.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:48.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:49.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:49.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:49.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:49.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:49.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:49.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:50.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:50.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:50.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:50.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:51.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:51.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:51.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:51.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:52.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:52.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:52.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:52.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:53.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:53.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:53.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:53.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:54.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:54.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:54.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:54.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:55.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:55.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:55.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:55.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:56.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:56.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:56.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:56.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:57.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:57.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:57.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:57.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:58.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:58.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:58.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:58.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:59.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:49:59.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:49:59.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:49:59.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:00.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:00.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:00.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:00.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:01.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:01.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:01.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:01.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:02.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:02.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:02.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:02.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:03.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:03.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:03.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:03.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:04.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:04.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:04.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:04.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:05.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:05.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:05.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:05.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:06.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:06.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:06.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:06.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:07.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:07.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:07.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:07.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:08.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:08.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:08.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:08.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:09.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:09.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:09.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:09.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:10.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:10.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:10.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:10.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:11.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:11.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:11.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:11.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:12.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:12.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:13.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:13.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:13.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:13.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:14.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:14.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:14.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:14.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:15.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:15.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:15.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:15.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:16.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:16.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:16.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:16.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:17.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:16.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:17.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:17.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:17.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:17.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:18.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:18.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:19.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:19.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:19.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:19.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:20.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:20.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:20.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:20.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:21.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:21.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:21.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:21.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:21.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:21.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:22.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:22.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:23.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:23.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:23.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:23.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:24.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:23.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:24.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:24.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:25.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:25.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:25.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:25.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:26.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:26.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:26.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:26.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:27.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:27.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:27.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:27.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:28.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:28.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:28.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:28.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:29.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:29.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:29.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:29.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:30.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:30.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:30.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:30.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:31.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:31.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:31.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:31.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:32.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:32.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:32.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:32.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:33.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:33.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:33.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:33.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:34.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:34.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:34.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:34.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:35.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:35.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:35.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:35.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:36.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:36.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:36.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:36.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:37.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:37.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:37.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:37.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:38.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:38.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:38.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:38.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:39.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:39.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:39.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:39.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:40.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:40.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:40.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:40.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:41.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:41.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:41.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:41.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:42.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:42.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:42.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:42.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:43.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:43.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:43.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:43.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:44.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:44.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:44.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:44.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:44.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:44.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:45.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:45.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:45.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:45.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:46.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:46.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:46.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:46.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:47.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:47.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:47.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:47.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:48.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:48.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:48.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:48.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:49.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:49.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:49.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:49.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:50.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:50.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:50.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:50.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:51.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:51.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:51.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:51.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:52.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:52.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:52.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:52.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:53.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:53.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:53.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:53.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:54.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:54.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:54.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:54.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:55.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:55.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:55.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:55.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:56.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:56.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:56.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:56.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:57.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:57.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:57.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:57.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:58.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:58.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:58.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:58.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:59.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:50:59.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:50:59.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:50:59.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:00.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:00.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:00.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:00.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:01.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:01.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:01.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:01.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:02.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:02.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:02.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:02.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:03.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:03.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:03.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:03.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:04.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:04.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:04.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:04.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:05.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:05.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:05.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:05.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:06.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:06.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:06.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:06.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:07.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:07.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:07.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:07.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:08.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:08.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:08.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:08.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:09.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:09.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:09.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:09.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:10.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:10.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:10.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:10.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:11.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:11.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:11.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:11.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:12.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:12.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:12.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:12.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:13.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:13.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:13.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:13.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:14.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:14.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:14.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:14.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:15.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:15.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:15.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:15.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:16.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:16.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:16.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:16.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:17.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:17.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:17.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:17.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:18.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:18.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:18.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:18.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:19.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:19.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:19.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:19.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:20.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:20.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:20.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:20.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:21.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:21.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:21.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:21.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:22.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:22.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:22.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:22.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:23.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:23.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:23.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:23.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:24.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:24.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:24.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:24.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:25.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:25.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:25.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:25.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:26.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:26.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:26.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:26.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:27.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:27.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:27.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:27.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:28.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:28.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:28.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:28.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:29.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:29.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:29.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:29.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:30.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:30.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:30.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:30.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:31.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:31.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:31.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:31.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:32.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:32.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:32.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:32.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:33.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:33.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:33.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:33.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:34.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:34.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:34.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:34.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:35.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:35.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:35.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:35.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:36.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:36.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:36.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:36.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:37.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:37.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:37.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:37.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:38.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:38.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:38.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:38.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:39.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:39.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:39.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:39.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:40.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:40.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:40.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:40.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:41.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:41.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:41.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:41.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:42.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:42.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:42.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:42.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:43.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:43.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:43.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:43.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:44.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:44.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:44.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:44.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:45.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:45.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:45.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:45.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:46.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:46.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:46.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:46.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:47.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:47.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:47.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:47.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:48.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:48.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:48.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:48.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:49.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:49.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:49.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:49.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:50.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:50.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:50.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:50.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:51.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:51.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:51.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:51.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:52.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:52.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:52.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:52.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:53.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:53.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:53.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:53.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:54.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:54.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:54.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:54.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:55.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:55.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:55.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:55.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:56.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:56.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:56.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:56.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:57.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:57.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:57.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:57.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:58.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:58.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:58.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:58.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:59.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:51:59.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:51:59.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:51:59.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:00.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:00.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:00.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:00.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:01.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:01.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:01.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:01.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:02.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:02.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:02.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:02.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:03.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:03.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:03.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:03.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:04.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:04.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:04.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:04.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:05.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:05.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:05.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:05.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:06.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:06.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:06.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:06.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:07.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:07.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:07.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:07.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:08.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:08.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:08.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:08.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:09.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:09.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:09.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:09.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:10.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:10.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:10.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:10.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:11.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:11.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:11.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:11.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:12.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:12.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:12.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:12.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:13.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:13.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:13.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:13.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:14.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:14.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:14.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:14.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:15.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:15.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:15.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:15.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:16.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:16.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:16.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:16.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:17.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:17.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:17.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:17.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:18.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:18.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:18.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:18.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:19.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:19.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:19.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:19.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:20.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:20.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:20.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:20.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:21.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:21.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:21.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:21.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:22.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:22.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:22.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:22.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:23.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:23.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:23.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:23.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:24.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:24.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:24.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:24.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:25.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:25.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:25.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:25.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:26.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:26.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:26.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:26.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:27.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:27.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:27.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:27.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:28.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:28.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:28.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:28.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:29.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:29.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:29.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:29.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:30.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:30.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:30.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:30.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:31.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:31.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:31.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:31.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:32.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:32.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:32.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:32.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:33.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:33.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:33.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:33.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:34.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:34.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:34.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:34.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:35.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:35.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:35.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:35.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:36.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:36.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:36.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:36.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:37.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:37.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:37.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:37.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:38.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:38.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:38.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:38.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:39.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:39.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:39.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:39.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:40.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:40.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:40.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:40.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:41.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:41.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:41.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:41.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:42.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:42.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:42.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:42.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:43.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:43.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:43.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:43.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:44.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:44.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:44.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:44.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:45.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:45.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:45.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:45.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:46.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:46.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:46.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:46.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:47.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:47.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:47.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:47.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:48.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:48.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:48.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:48.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:49.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:49.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:49.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:49.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:50.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:50.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:50.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:50.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:51.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:51.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:51.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:51.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:52.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:52.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:52.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:52.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:53.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:53.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:53.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:53.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:54.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:54.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:54.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:54.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:55.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:55.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:55.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:55.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:56.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:56.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:56.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:56.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:57.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:57.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:57.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:57.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:58.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:58.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:58.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:58.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:59.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:52:59.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:52:59.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:52:59.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:00.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:00.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:00.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:00.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:01.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:01.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:01.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:01.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:02.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:02.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:02.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:02.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:03.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:03.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:03.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:03.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:04.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:04.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:04.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:04.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:05.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:05.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:05.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:05.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:06.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:06.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:06.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:06.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:07.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:07.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:07.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:07.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:08.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:08.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:08.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:08.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:09.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:09.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:09.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:09.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:10.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:10.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:10.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:10.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:11.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:11.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:11.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:11.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:12.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:12.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:12.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:12.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:13.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:13.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:13.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:13.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:14.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:14.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:14.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:14.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:15.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:15.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:15.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:15.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:16.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:16.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:16.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:16.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:17.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:17.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:18.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:18.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:18.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:18.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:19.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:19.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:19.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:19.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:20.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:20.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:20.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:20.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:21.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:21.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:21.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:21.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:22.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:22.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:22.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:22.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:23.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:23.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:23.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:23.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:24.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:24.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:24.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:24.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:25.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:25.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:25.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:25.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:26.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:26.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:26.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:26.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:27.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:27.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:27.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:27.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:27.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:27.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:28.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:28.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:29.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:29.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:29.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:29.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:30.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:30.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:30.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:30.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:31.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:31.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:31.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:31.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:32.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:32.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:32.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:32.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:33.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:33.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:33.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:33.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:34.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:34.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:34.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:34.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:35.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:35.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:35.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:35.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:36.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:36.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:36.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:36.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:37.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:37.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:37.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:37.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:38.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:38.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:38.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:38.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:39.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:39.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:39.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:39.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:40.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:40.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:40.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:40.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:41.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:41.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:41.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:41.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:42.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:42.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:42.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:42.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:43.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:43.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:43.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:43.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:44.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:44.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:44.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:44.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:45.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:45.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:45.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:45.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:46.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:46.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:46.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:46.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:47.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:47.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:47.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:47.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:48.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:48.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:48.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:48.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:49.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:49.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:49.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:49.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:50.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:50.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:50.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:50.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:51.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:51.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:51.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:51.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:52.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:52.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:52.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:52.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:53.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:53.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:53.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:53.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:54.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:54.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:54.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:54.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:55.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:55.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:55.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:55.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:56.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:56.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:56.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:56.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:57.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:57.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:57.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:57.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:58.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:58.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:58.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:58.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:59.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:53:59.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:53:59.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:53:59.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:00.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:00.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:00.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:00.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:01.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:01.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:01.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:01.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:02.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:02.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:02.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:02.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:03.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:03.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:03.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:03.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:04.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:04.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:04.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:04.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:05.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:05.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:05.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:05.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:06.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:06.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:06.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:06.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:07.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:07.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:07.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:07.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:08.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:08.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:08.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:08.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:09.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:09.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:09.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:09.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:10.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:10.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:10.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:10.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:11.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:11.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:11.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:11.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:12.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:12.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:12.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:12.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:13.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:13.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:13.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:13.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:14.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:14.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:14.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:14.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:15.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:15.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:15.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:15.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:16.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:16.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:16.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:16.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:17.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:17.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:17.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:17.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:18.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:18.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:18.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:18.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:19.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:19.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:19.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:19.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:20.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:20.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:20.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:20.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:21.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:21.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:21.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:21.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:22.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:22.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:22.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:22.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:23.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:23.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:23.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:23.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:24.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:24.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:24.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:24.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:25.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:25.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:25.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:25.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:26.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:26.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:26.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:26.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:27.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:27.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:27.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:27.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:28.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:28.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:28.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:28.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:29.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:29.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:29.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:29.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:30.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:30.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:30.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:30.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:31.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:31.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:31.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:31.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:32.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:32.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:32.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:32.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:33.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:33.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:33.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:33.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:34.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:34.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:34.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:34.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:35.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:35.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:35.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:35.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:35.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:35.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:36.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:36.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:37.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:37.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:37.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:37.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:37.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:37.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:38.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:38.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:39.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:39.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:39.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:39.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:40.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:40.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:40.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:40.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:41.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:41.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:41.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:41.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:42.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:42.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:42.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:42.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:43.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:43.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:43.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:43.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:44.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:44.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:44.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:44.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:45.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:45.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:45.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:45.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:46.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:46.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:46.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:46.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:47.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:47.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:47.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:47.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:48.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:48.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:48.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:48.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:49.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:49.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:49.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:49.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:50.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:50.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:50.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:50.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:51.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:51.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:51.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:51.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:52.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:52.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:52.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:52.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:53.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:53.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:53.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:53.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:54.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:54.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:54.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:54.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:55.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:55.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:55.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:55.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:56.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:56.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:56.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:56.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:57.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:57.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:57.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:57.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:58.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:58.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:58.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:58.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:59.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:54:59.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:54:59.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:54:59.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:00.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:00.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:00.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:00.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:01.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:01.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:01.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:01.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:02.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:02.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:02.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:02.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:03.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:03.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:03.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:03.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:04.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:04.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:04.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:04.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:05.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:05.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:05.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:05.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:06.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:06.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:06.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:06.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:07.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:07.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:07.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:07.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:08.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:08.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:08.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:08.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:09.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:09.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:09.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:09.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:10.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:10.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:10.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:10.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:11.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:11.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:11.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:11.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:12.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:12.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:12.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:12.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:13.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:13.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:13.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:13.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:14.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:14.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:14.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:14.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:15.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:15.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:15.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:15.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:16.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:16.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:16.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:16.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:17.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:17.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:17.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:17.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:18.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:18.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:18.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:18.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:19.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:19.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:19.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:19.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:20.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:20.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:20.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:20.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:21.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:21.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:21.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:21.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:22.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:22.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:22.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:22.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:23.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:23.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:23.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:23.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:24.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:24.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:24.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:24.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:25.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:25.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:25.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:25.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:26.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:26.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:26.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:26.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:27.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:27.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:27.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:27.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:28.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:28.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:28.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:28.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:29.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:29.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:29.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:29.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:30.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:30.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:30.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:30.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:31.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:31.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:31.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:31.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:32.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:32.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:32.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:32.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:33.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:33.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:33.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:33.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:34.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:34.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:34.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:34.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:35.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:35.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:35.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:35.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:36.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:36.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:36.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:36.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:37.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:37.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:37.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:37.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:38.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:38.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:38.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:38.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:39.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:39.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:39.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:39.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:40.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:40.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:40.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:40.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:41.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:41.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:41.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:41.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:42.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:42.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:42.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:42.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:43.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:43.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:43.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:43.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:44.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:44.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:44.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:44.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:45.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:45.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:45.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:45.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:46.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:46.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:46.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:46.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:47.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:47.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:47.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:47.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:48.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:48.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:48.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:48.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:49.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:49.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:49.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:49.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:50.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:50.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:50.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:50.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:51.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:51.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:51.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:51.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:52.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:52.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:52.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:52.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:53.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:53.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:53.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:53.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:54.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:54.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:54.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:54.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:55.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:55.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:55.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:55.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:56.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:56.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:56.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:56.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:57.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:57.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:57.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:57.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:58.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:58.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:58.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:58.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:59.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:55:59.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:55:59.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:55:59.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:00.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:00.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:00.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:00.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:01.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:01.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:01.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:01.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:02.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:02.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:02.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:02.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:03.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:03.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:03.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:03.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:04.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:04.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:04.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:04.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:05.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:05.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:05.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:05.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:06.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:06.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:06.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:06.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:07.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:07.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:07.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:07.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:08.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:08.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:08.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:08.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:09.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:09.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:09.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:09.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:10.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:10.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:10.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:10.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:11.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:11.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:11.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:11.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:12.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:12.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:12.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:12.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:13.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:13.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:13.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:13.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:14.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:14.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:14.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:14.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:15.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:15.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:15.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:15.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:16.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:16.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:16.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:16.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:17.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:17.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:17.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:17.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:18.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:18.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:18.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:18.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:19.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:19.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:19.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:19.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:20.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:20.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:20.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:20.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:21.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:21.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:21.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:21.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:22.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:22.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:22.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:22.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:23.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:23.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:23.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:23.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:24.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:24.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:24.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:24.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:25.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:25.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:25.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:25.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:26.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:26.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:26.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:26.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:27.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:27.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:27.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:27.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:28.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:27.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:28.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:28.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:28.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:28.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:29.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:29.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:29.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:29.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:30.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:30.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:30.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:30.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:31.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:31.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:31.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:31.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:32.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:32.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:32.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:32.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:33.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:33.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:33.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:33.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:34.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:34.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:35.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:35.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:35.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:35.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:36.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:36.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:36.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:36.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:37.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:37.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:37.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:37.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:38.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:38.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:38.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:38.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:39.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:39.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:39.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:39.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:40.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:40.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:40.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:40.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:41.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:41.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:41.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:41.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:42.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:42.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:42.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:42.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:43.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:43.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:43.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:43.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:44.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:44.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:44.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:44.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:45.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:45.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:45.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:45.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:46.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:46.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:46.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:46.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:47.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:47.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:47.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:47.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:48.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:48.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:48.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:48.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:49.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:49.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:49.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:49.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:50.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:50.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:50.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:50.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:51.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:51.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:51.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:51.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:52.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:52.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:52.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:52.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:53.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:53.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:53.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:53.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:54.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:54.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:54.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:54.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:55.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:55.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:55.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:55.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:56.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:56.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:56.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:56.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:57.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:57.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:57.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:57.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:58.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:58.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:58.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:58.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:59.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:56:59.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:56:59.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:56:59.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:00.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:00.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:00.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:00.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:01.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:01.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:01.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:01.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:02.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:02.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:02.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:02.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:03.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:03.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:03.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:03.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:04.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:04.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:04.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:04.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:05.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:05.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:05.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:05.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:06.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:06.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:06.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:06.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:07.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:07.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:07.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:07.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:08.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:08.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:08.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:08.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:09.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:09.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:09.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:09.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:10.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:10.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:10.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:10.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:11.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:11.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:11.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:11.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:12.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:12.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:12.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:12.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:13.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:13.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:13.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:13.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:14.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:14.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:14.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:14.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:15.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:15.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:15.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:15.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:16.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:16.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:16.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:16.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:17.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:17.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:17.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:17.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:18.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:18.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:18.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:18.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:19.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:19.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:19.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:19.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:20.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:20.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:20.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:20.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:21.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:21.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:21.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:21.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:22.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:22.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:22.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:22.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:23.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:23.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:23.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:23.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:24.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:24.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:24.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:24.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:25.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:25.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:25.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:25.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:26.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:26.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:26.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:26.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:27.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:27.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:27.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:27.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:28.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:28.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:28.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:28.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:29.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:29.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:29.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:29.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:30.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:30.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:30.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:30.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:31.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:31.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:31.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:31.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:32.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:32.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:33.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:33.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:33.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:33.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:34.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:34.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:34.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:34.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:35.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:35.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:35.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:35.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:36.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:36.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:36.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:36.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:37.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:37.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:37.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:37.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:38.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:38.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:38.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:38.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:39.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:39.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:39.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:39.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:40.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:40.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:40.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:40.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:41.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:41.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:41.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:41.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:42.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:42.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:42.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:42.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:43.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:43.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:43.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:43.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:44.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:44.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:44.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:44.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:45.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:45.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:45.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:45.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:46.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:46.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:46.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:46.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:47.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:47.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:47.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:47.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:48.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:48.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:48.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:48.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:49.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:49.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:49.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:49.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:50.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:50.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:50.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:50.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:51.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:51.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:51.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:51.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:52.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:52.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:52.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:52.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:53.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:53.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:53.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:53.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:54.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:54.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:54.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:54.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:55.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:55.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:55.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:55.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:56.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:56.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:56.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:56.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:57.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:57.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:57.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:57.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:58.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:58.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:58.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:58.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:59.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:57:59.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:57:59.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:57:59.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:00.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:00.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:00.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:00.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:01.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:01.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:01.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:01.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:02.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:02.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:02.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:02.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:03.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:03.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:03.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:03.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:04.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:04.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:04.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:04.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:05.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:05.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:05.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:05.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:06.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:06.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:06.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:06.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:07.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:07.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:07.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:07.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:08.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:08.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:08.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:08.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:09.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:09.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:09.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:09.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:10.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:10.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:10.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:10.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:11.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:11.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:11.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:11.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:12.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:12.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:12.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:12.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:13.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:13.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:13.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:13.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:14.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:14.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:14.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:14.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:15.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:15.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:15.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:15.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:16.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:16.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:16.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:16.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:17.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:17.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:17.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:17.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:18.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:18.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:18.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:18.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:19.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:19.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:19.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:19.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:20.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:20.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:20.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:20.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:21.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:21.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:21.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:21.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:22.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:22.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:22.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:22.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:23.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:23.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:23.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:23.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:24.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:24.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:24.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:24.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:25.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:25.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:25.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:25.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:26.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:26.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:26.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:26.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:27.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:27.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:27.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:27.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:28.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:28.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:28.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:28.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:29.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:29.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:29.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:29.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:30.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:30.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:30.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:30.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:31.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:31.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:31.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:31.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:32.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:32.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:32.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:32.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:33.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:33.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:33.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:33.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:34.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:34.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:34.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:34.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:35.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:35.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:35.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:35.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:36.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:36.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:36.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:36.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:37.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:37.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:37.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:37.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:38.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:38.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:38.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:38.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:39.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:39.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:39.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:39.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:40.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:40.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:40.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:40.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:41.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:41.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:41.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:41.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:42.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:42.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:42.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:42.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:43.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:43.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:43.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:43.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:44.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:44.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:44.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:44.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:45.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:45.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:45.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:45.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:46.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:46.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:46.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:46.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:47.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:47.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:47.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:47.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:48.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:48.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:48.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:48.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:49.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:49.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:49.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:49.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:50.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:50.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:50.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:50.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:50.530 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T22:58:50.527+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac03be80 msgr2=0x7f81ac040dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T22:58:51.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:51.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:51.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:51.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:52.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:52.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:52.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:52.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:53.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:53.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:53.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:53.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:54.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:54.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:54.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:54.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:55.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:55.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:55.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:55.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:56.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:56.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:56.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:56.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:57.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:57.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:57.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:57.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:58.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:58.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:58.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:58.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:59.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:58:59.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:58:59.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:58:59.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:00.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:00.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:00.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:00.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:01.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:01.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:01.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:01.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:02.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:02.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:02.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:02.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:03.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:03.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:03.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:03.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:04.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:04.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:04.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:04.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:05.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:05.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:05.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:05.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:06.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:06.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:06.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:06.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:07.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:07.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:07.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:07.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:08.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:08.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:08.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:08.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:09.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:09.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:09.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:09.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:10.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:10.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:10.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:10.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:10.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:10.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:11.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:11.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:11.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:11.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:12.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:12.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:12.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:12.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:13.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:13.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:13.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:13.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:14.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:14.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:14.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:14.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:15.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:15.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:15.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:15.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:16.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:16.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:16.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:16.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:17.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:17.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:17.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:17.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:18.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:18.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:18.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:18.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:19.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:19.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:20.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:19.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:20.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:20.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:20.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:20.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:21.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:21.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:21.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:21.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:22.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:22.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:22.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:22.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:23.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:23.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:23.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:23.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:24.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:24.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:24.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:24.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:25.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:25.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:25.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:25.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:26.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:26.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:27.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:26.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:27.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:27.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:27.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:27.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:28.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:28.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:29.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:29.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:29.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:29.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:30.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:30.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:30.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:30.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:31.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:31.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:31.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:31.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:32.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:32.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:32.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:32.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:33.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:33.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:33.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:33.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:34.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:34.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:34.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:34.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:35.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:35.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:35.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:35.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:36.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:36.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:36.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:36.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:37.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:37.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:37.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:37.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:38.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:38.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:38.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:38.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:39.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:39.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:39.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:39.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:40.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:40.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:40.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:40.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:41.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:41.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:41.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:41.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:42.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:42.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:42.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:42.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:43.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:43.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:43.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:43.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:44.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:44.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:44.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:44.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:45.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:45.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:45.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:45.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:45.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:45.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:46.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:46.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:46.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:46.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:47.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:47.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:47.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:47.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:48.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:48.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:48.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:48.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:49.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:49.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:49.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:49.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:50.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:50.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:50.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:50.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:51.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:51.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:51.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:51.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:52.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:52.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:52.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:52.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:53.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:53.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:53.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:53.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:54.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:54.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:55.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:55.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:55.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:55.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:56.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:56.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:56.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:56.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:57.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:57.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:57.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:57.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:58.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:58.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:58.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:58.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:59.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T22:59:59.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T22:59:59.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T22:59:59.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:00.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:00.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:00.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:00.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:01.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:01.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:01.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:01.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:02.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:02.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:02.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:02.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:03.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:03.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:03.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:03.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:04.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:04.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:04.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:04.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:05.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:05.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:05.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:05.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:06.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:06.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:06.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:06.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:07.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:07.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:07.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:07.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:08.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:08.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:08.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:08.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:09.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:09.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:09.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:09.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:10.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:10.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:10.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:10.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:11.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:11.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:11.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:11.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:12.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:12.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:12.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:12.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:13.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:13.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:13.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:13.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:14.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:14.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:14.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:14.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:15.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:15.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:15.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:15.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:16.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:16.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:16.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:16.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:17.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:17.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:17.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:17.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:18.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:18.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:18.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:18.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:19.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:19.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:19.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:19.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:20.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:20.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:20.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:20.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:21.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:21.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:21.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:21.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:22.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:22.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:22.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:22.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:23.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:23.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:23.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:23.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:24.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:24.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:24.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:24.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:25.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:25.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:25.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:25.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:26.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:26.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:26.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:26.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:27.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:27.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:27.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:27.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:28.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:28.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:28.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:28.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:29.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:29.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:29.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:29.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:30.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:30.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:30.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:30.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:31.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:31.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:31.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:31.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:32.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:32.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:32.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:32.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:33.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:33.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:33.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:33.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:34.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:34.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:34.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:34.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:34.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:34.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:35.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:35.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:35.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:35.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:36.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:36.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:36.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:36.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:37.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:37.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:37.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:37.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:38.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:38.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:38.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:38.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:39.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:39.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:39.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:39.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:40.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:40.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:40.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:40.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:41.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:41.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:41.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:41.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:42.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:42.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:42.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:42.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:43.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:43.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:43.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:43.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:44.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:44.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:44.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:44.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:45.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:45.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:45.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:45.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:46.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:46.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:46.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:46.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:47.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:47.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:47.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:47.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:48.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:48.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:48.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:48.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:49.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:49.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:49.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:49.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:50.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:50.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:50.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:50.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:51.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:51.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:51.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:51.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:52.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:52.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:52.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:52.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:53.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:53.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:53.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:53.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:54.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:54.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:54.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:54.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:55.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:55.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:55.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:55.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:56.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:56.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:56.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:56.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:57.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:57.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:57.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:57.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:58.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:58.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:58.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:58.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:59.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:00:59.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:00:59.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:00:59.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:00.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:00.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:00.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:00.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:01.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:01.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:01.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:01.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:02.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:02.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:02.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:02.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:03.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:03.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:03.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:03.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:04.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:04.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:04.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:04.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:05.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:05.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:05.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:05.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:06.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:06.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:06.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:06.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:07.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:07.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:07.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:07.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:08.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:08.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:08.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:08.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:09.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:09.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:09.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:09.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:10.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:10.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:10.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:10.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:11.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:11.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:11.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:11.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 99 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:12.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:12.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:12.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:12.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:13.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:13.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:13.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:13.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:14.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:14.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:14.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:14.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:15.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:15.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:15.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:15.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:16.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:16.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:16.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:16.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:17.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:17.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:17.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:17.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:18.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:18.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:18.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:18.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:19.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:19.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:19.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:19.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:20.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:20.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:20.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:20.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:21.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:21.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:21.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:21.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:22.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:22.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:22.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:22.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:23.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:23.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:23.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:23.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:24.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:24.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:24.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:24.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:25.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:25.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:25.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:25.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:26.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:26.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:26.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:26.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:27.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:27.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:27.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:27.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:28.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:28.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:28.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:28.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:29.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:29.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:29.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:29.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:30.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:30.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:30.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:30.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:31.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:31.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:31.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:31.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:32.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:32.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:32.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:32.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:33.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:33.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:33.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:33.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:34.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:34.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:34.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:34.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:35.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:35.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:35.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:35.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:36.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:36.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:36.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:36.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:37.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:37.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:37.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:37.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:38.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:38.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:38.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:38.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:39.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:39.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:39.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:39.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:40.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:40.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:40.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:40.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:41.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:41.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:41.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:41.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 31 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:01:42.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:42.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:42.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:42.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:43.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:43.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:43.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:43.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:44.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:44.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:44.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:44.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:45.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:45.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:45.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:45.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:46.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:46.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:46.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:46.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:47.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:47.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:47.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:47.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:48.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:48.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:48.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:48.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:49.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:49.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:49.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:49.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:50.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:50.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:50.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:50.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:51.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:51.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:51.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:51.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:52.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:52.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:52.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:52.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:53.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:53.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:53.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:53.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:54.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:54.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:54.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:54.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:55.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:55.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:55.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:55.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:56.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:56.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:56.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:56.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:57.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:57.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:57.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:57.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:58.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:58.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:58.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:58.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:59.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:01:59.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:01:59.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:01:59.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:00.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:00.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:00.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:00.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:01.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:01.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:01.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:01.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:02.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:02.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:02.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:02.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:03.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:03.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:03.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:03.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:04.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:04.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:04.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:04.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:05.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:05.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:05.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:05.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:06.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:06.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:06.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:06.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:07.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:07.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:07.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:07.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:08.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:08.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:08.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:08.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:09.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:09.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:09.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:09.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:10.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:10.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:10.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:10.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:11.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:11.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:11.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:11.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:12.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:12.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:12.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:12.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:13.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:13.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:13.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:13.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:14.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:14.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:14.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:14.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:15.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:15.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:15.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:15.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:16.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:16.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:16.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:16.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:17.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:17.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:17.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:17.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:18.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:18.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:18.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:18.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:19.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:19.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:19.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:19.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:20.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:20.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:20.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:20.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:21.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:21.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:21.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:21.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:22.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:22.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:22.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:22.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:23.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:23.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:23.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:23.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:24.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:24.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:24.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:24.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:25.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:25.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:25.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:25.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:26.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:26.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:26.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:26.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:27.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:27.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:27.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:27.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:28.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:28.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:28.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:28.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:29.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:29.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:29.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:29.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:30.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:30.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:30.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:30.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:31.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:31.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:31.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:31.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:32.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:32.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:32.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:32.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:33.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:33.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:33.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:33.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:34.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:34.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:34.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:34.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:35.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:35.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:35.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:35.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:36.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:36.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:36.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:36.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:37.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:37.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:37.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:37.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:38.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:38.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:38.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:38.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:39.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:39.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:39.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:39.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:40.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:40.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:40.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:40.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:41.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:41.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:41.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:41.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:42.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:42.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:42.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:42.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:43.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:43.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:43.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:43.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:44.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:44.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:44.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:44.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:45.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:45.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:45.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:45.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:46.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:46.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:46.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:46.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:47.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:47.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:47.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:47.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:48.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:48.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:48.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:48.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:49.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:49.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:49.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:49.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:50.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:50.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:50.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:50.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:51.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:51.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:51.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:51.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:52.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:52.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:52.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:52.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:53.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:53.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:53.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:53.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:54.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:54.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:54.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:54.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:55.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:55.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:55.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:55.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:56.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:56.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:56.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:56.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:57.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:57.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:57.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:57.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:58.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:58.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:58.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:58.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:59.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:02:59.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:02:59.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:02:59.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:00.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:00.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:00.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:00.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:01.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:01.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:01.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:01.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:02.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:02.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:02.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:02.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:03.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:03.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:03.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:03.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:04.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:04.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:04.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:04.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:05.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:05.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:05.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:05.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:06.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:06.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:06.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:06.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:07.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:07.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:07.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:07.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:08.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:08.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:08.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:08.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:09.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:09.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:09.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:09.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:10.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:10.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:10.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:10.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:11.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:11.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:11.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:11.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:12.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:12.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:12.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:12.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:13.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:13.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:13.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:13.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:14.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:14.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:14.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:14.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:15.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:15.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:15.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:15.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:16.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:16.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:16.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:16.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:17.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:17.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:18.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:18.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:18.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:18.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:19.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:19.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:19.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:19.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:20.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:20.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:20.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:20.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:21.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:21.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:21.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:21.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:22.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:22.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:22.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:22.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:23.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:23.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:23.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:23.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:24.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:24.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:24.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:24.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:25.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:25.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:25.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:25.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:26.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:26.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:26.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:26.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:27.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:27.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:27.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:27.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:27.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:27.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:28.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:28.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:28.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:28.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:29.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:29.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:30.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:30.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:30.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:30.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:30.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:30.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:31.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:31.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:31.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:31.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:32.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:32.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:33.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:33.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:33.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:33.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:33.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:33.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:34.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:34.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:34.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:34.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:35.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:35.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:35.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:35.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:36.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:36.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:36.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:36.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:37.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:37.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:37.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:37.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:38.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:38.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:38.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:38.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:39.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:39.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:39.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:39.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:40.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:40.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:40.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:40.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:41.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:41.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:41.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:41.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:42.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:42.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:42.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:42.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:43.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:43.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:43.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:43.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:44.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:44.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:44.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:44.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:45.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:45.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:45.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:45.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:46.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:46.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:46.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:46.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:47.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:47.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:47.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:47.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:48.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:48.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:48.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:48.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:49.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:49.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:49.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:49.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:50.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:50.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:50.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:50.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:51.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:51.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:51.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:51.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:52.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:52.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:52.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:52.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:53.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:53.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:53.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:53.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:54.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:54.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:54.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:54.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:55.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:55.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:55.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:55.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:56.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:56.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:56.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:56.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:57.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:57.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:57.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:57.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:58.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:58.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:58.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:58.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:59.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:03:59.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:03:59.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:03:59.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:00.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:00.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:00.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:00.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:01.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:01.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:01.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:01.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:02.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:02.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:02.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:02.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:03.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:03.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:03.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:03.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:04.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:04.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:04.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:04.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:05.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:05.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:05.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:05.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:06.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:06.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:06.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:06.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:07.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:07.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:07.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:07.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:08.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:08.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:08.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:08.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:09.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:09.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:09.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:09.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:10.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:10.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:10.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:10.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:11.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:11.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:11.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:11.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:12.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:12.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:12.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:12.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:12.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:12.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:13.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:13.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:13.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:13.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:14.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:14.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:15.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:15.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:15.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:15.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:15.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:15.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:16.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:16.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:16.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:16.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:17.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:17.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:18.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:18.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:18.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:18.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:19.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:19.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:19.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:19.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:20.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:20.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:20.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:20.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:21.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:21.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:21.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:21.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:22.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:22.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:22.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:22.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:23.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:23.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:23.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:23.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:24.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:24.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:24.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:24.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:24.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:24.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:25.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:25.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:25.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:25.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:26.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:26.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:26.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:26.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:27.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:27.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:27.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:27.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:28.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:28.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:28.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:28.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:29.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:29.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:30.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:30.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:30.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:30.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:31.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:31.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:31.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:31.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:32.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:32.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:32.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:32.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:33.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:33.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:33.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:33.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:33.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:33.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:34.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:34.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:35.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:35.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:35.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:35.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:36.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:36.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:36.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:36.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:37.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:37.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:37.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:37.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:38.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:38.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:38.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:38.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:39.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:39.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:39.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:39.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:40.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:40.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:40.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:40.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:41.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:41.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:41.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:41.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:42.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:42.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:42.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:42.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:43.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:43.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:43.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:43.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:44.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:44.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:44.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:44.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:45.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:45.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:45.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:45.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:46.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:46.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:46.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:46.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:47.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:47.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:47.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:47.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:48.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:48.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:48.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:48.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:49.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:49.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:49.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:49.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:50.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:50.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:50.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:50.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:51.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:51.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:51.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:51.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:52.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:52.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:52.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:52.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:53.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:53.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:53.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:53.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:54.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:54.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:54.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:54.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:55.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:55.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:55.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:55.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:56.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:56.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:56.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:56.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:57.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:57.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:57.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:57.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:58.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:58.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:58.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:58.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:59.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:04:59.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:04:59.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:04:59.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:00.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:00.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:00.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:00.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:01.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:01.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:01.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:01.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:02.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:02.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:02.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:02.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:03.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:03.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:03.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:03.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:04.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:04.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:04.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:04.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:05.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:05.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:05.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:05.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:06.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:06.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:06.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:06.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:07.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:07.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:07.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:07.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:08.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:08.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:08.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:08.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:09.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:09.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:09.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:09.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:10.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:10.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:10.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:10.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:11.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:11.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:11.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:11.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:12.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:12.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:12.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:12.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:13.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:13.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:13.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:13.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:14.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:14.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:14.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:14.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:15.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:15.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:15.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:15.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:16.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:16.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:16.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:16.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:17.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:17.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:17.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:17.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:18.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:18.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:18.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:18.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:19.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:19.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:19.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:19.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:20.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:20.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:20.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:20.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:21.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:21.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:21.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:21.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:22.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:22.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:22.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:22.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:23.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:23.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:23.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:23.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:24.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:24.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:24.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:24.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:25.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:25.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:25.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:25.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:26.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:26.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:26.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:26.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:27.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:27.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:27.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:27.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:28.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:28.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:28.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:28.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:29.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:29.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:29.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:29.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:30.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:30.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:30.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:30.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:31.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:31.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:31.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:31.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:32.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:32.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:32.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:32.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:33.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:33.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:33.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:33.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:34.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:34.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:34.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:34.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:35.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:35.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:35.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:35.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:36.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:36.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:36.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:36.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:37.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:37.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:37.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:37.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:38.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:38.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:38.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:38.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:39.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:39.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:39.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:39.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:40.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:40.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:40.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:40.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:41.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:41.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:41.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:41.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:42.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:42.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:42.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:42.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:43.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:43.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:43.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:43.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:44.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:44.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:44.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:44.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:45.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:45.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:45.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:45.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:46.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:46.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:46.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:46.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:47.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:47.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:47.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:47.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:48.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:48.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:48.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:48.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:49.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:49.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:49.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:49.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:50.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:50.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:50.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:50.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:51.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:51.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:51.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:51.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:52.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:52.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:52.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:52.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:53.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:53.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:53.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:53.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:54.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:54.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:54.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:54.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:55.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:55.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:55.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:55.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:56.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:56.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:56.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:56.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:57.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:57.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:57.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:57.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:58.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:58.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:58.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:58.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:59.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:05:59.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:05:59.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:05:59.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:00.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:00.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:00.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:00.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:01.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:01.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:01.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:01.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:02.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:02.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:02.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:02.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:03.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:03.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:03.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:03.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:04.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:04.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:04.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:04.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:05.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:05.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:05.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:05.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:06.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:06.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:06.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:06.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:07.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:07.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:07.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:07.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:08.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:08.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:08.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:08.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:09.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:09.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:09.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:09.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:10.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:10.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:10.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:10.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:11.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:11.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:11.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:11.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:12.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:12.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:12.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:12.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:13.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:13.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:13.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:13.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:14.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:14.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:14.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:14.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:15.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:15.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:15.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:15.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:16.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:16.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:16.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:16.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:17.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:17.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:17.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:17.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:18.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:18.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:18.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:18.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:19.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:19.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:19.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:19.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:20.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:20.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:20.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:20.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:21.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:21.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:21.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:21.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:22.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:22.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:22.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:22.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:23.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:23.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:23.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:23.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:24.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:24.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:24.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:24.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:25.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:25.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:25.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:25.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:26.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:26.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:26.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:26.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:27.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:27.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:27.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:27.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:28.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:28.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:28.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:28.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:29.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:29.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:29.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:29.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:30.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:30.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:30.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:30.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:31.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:31.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:31.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:31.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:32.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:32.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:32.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:32.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:33.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:33.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:33.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:33.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:34.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:34.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:34.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:34.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:35.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:35.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:35.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:35.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:36.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:36.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:36.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:36.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:37.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:37.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:37.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:37.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:38.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:38.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:38.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:38.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:39.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:39.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:39.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:39.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:40.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:40.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:40.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:40.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:41.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:41.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:41.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:41.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:42.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:42.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:42.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:42.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:43.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:43.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:43.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:43.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:44.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:44.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:44.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:44.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:45.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:45.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:45.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:45.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:46.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:46.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:46.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:46.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:47.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:47.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:47.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:47.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:48.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:48.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:48.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:48.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:49.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:49.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:49.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:49.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:50.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:50.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:50.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:50.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:51.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:51.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:51.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:51.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:52.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:52.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:52.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:52.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:53.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:53.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:53.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:53.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:54.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:54.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:54.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:54.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:55.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:55.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:55.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:55.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:56.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:56.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:56.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:56.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:57.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:57.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:57.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:57.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:58.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:58.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:58.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:58.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:59.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:06:59.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:06:59.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:06:59.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:00.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:00.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:00.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:00.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:01.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:01.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:01.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:01.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:02.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:02.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:02.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:02.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:03.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:03.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:03.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:03.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:04.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:04.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:04.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:04.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:05.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:05.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:05.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:05.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:06.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:06.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:06.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:06.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:07.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:07.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:07.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:07.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:08.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:08.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:08.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:08.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:09.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:09.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:09.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:09.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:10.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:10.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:10.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:10.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:11.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:11.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:11.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:11.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:12.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:12.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:12.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:12.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:13.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:13.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:13.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:13.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:14.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:14.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:14.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:14.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:15.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:15.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:15.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:15.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:16.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:16.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:16.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:16.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:17.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:17.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:17.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:17.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:18.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:18.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:18.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:18.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:19.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:19.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:19.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:19.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:20.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:20.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:20.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:20.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:21.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:21.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:21.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:21.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:22.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:22.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:22.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:22.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:23.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:23.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:23.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:23.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:24.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:24.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:24.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:24.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:25.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:25.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:25.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:25.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:26.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:26.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:26.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:26.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:27.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:27.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:27.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:27.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:28.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:28.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:28.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:28.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:29.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:29.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:29.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:29.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:30.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:30.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:30.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:30.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:31.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:31.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:31.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:31.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:32.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:32.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:32.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:32.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:33.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:33.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:33.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:33.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:34.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:34.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:34.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:34.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:35.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:35.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:35.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:35.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:36.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:36.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:36.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:36.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:37.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:37.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:37.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:37.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:38.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:38.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:38.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:38.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:39.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:39.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:39.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:39.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:40.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:40.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:40.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:40.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:41.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:41.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:41.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:41.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:42.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:42.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:42.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:42.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:43.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:43.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:43.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:43.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:44.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:44.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:44.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:44.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:45.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:45.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:45.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:45.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:46.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:46.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:46.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:46.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:47.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:47.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:47.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:47.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:48.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:48.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:48.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:48.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:49.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:49.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:49.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:49.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:50.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:50.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:50.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:50.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:51.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:51.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:51.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:51.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:52.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:52.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:52.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:52.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:53.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:53.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:53.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:53.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:54.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:54.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:54.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:54.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:55.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:55.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:55.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:55.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:56.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:56.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:56.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:56.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:57.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:57.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:57.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:57.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:58.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:58.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:58.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:58.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:59.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:59.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:59.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:07:59.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:07:59.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:07:59.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:00.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:00.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:00.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:00.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:01.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:01.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:01.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:01.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:02.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:02.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:02.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:02.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:03.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:03.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:03.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:03.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:04.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:04.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:04.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:04.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:05.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:05.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:05.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:05.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:06.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:06.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:07.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:07.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:07.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:07.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:08.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:08.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:08.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:08.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:09.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:09.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:09.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:09.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:10.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:10.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:10.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:10.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:11.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:11.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:11.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:11.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:12.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:12.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:12.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:12.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:12.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:12.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:13.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:13.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:13.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:13.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:14.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:14.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:15.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:15.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:15.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:15.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:16.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:16.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:16.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:16.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:17.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:17.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:17.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:17.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:18.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:18.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:18.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:18.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:19.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:19.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:19.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:19.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:20.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:20.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:20.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:20.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:21.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:21.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:21.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:21.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:22.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:22.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:22.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:22.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:23.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:23.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:23.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:23.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:24.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:24.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:24.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:24.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:25.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:25.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:25.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:25.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:26.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:26.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:26.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:26.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:27.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:27.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:27.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:27.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:28.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:28.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:28.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:28.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:29.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:29.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:29.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:29.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:30.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:30.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:30.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:30.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:31.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:31.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:31.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:31.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:32.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:32.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:32.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:32.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:33.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:33.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:33.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:33.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:34.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:34.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:34.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:34.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:35.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:35.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:35.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:35.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:36.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:36.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:36.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:36.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:37.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:37.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:37.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:37.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:38.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:38.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:38.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:38.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:39.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:39.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:39.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:39.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:40.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:40.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:40.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:40.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:41.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:41.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:41.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:41.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:42.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:42.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:42.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:42.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:43.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:43.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:43.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:43.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:43.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:43.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:44.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:44.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:44.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:44.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:45.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:45.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:45.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:45.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:46.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:46.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:46.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:46.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:47.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:47.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:47.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:47.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:48.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:48.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:48.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:48.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:49.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:49.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:49.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:49.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:50.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:50.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:50.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:50.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:51.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:51.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:51.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:51.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:52.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:52.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:52.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:52.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:53.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:53.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:54.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:54.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:54.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:54.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:55.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:55.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:55.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:55.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:56.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:56.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:56.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:56.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:57.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:57.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:57.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:57.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:57.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:57.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:58.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:58.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:58.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:08:58.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:08:59.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:08:59.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:00.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:00.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:00.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:00.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:01.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:01.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:01.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:01.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:02.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:02.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:03.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:03.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:03.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:03.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:04.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:04.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:04.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:04.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:05.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:05.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:05.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:05.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:06.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:06.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:06.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:06.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:07.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:07.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:07.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:07.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:08.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:08.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:08.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:08.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:09.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:09.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:09.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:09.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:10.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:10.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:10.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:10.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:11.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:11.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:11.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:11.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:12.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:12.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:12.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:12.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:13.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:13.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:13.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:13.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:14.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:14.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:14.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:14.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:15.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:15.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:15.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:15.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:15.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:15.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:16.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:16.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:17.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:17.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:17.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:17.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:18.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:18.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:18.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:18.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:19.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:19.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:19.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:19.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:20.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:20.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:20.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:20.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:21.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:21.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:21.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:21.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:21.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:21.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:22.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:22.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:22.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:22.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:23.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:23.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:23.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:23.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:24.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:24.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:24.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:24.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:24.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:24.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:25.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:25.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:26.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:26.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:26.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:26.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:27.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:27.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:27.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:27.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:28.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:28.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:28.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:28.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:29.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:29.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:29.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:29.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:30.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:30.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:30.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:30.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:31.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:31.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:31.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:31.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:32.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:32.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:32.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:32.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:33.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:33.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:33.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:33.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:34.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:34.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:34.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:34.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:35.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:35.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:35.650 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T23:09:35.647+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac125ae0 msgr2=0x7f81ac0ca6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-22T23:09:35.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:35.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:36.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:36.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:36.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:36.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:37.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:37.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:37.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:37.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:37.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:37.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:38.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:38.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:39.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:39.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:39.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:39.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:40.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:40.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:40.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:40.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:41.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:41.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:41.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:41.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:42.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:42.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:42.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:42.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:43.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:43.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:43.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:43.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:44.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:44.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:45.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:45.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:45.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:45.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:45.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:45.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:46.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:46.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:46.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:46.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:47.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:47.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:47.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:47.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:47.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:47.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:48.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:48.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:48.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:48.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:49.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:49.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:50.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:50.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:50.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:50.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:51.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:51.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:51.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:51.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:52.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:52.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:52.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:52.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:53.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:53.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:54.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:54.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:54.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:54.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:55.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:55.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:55.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:55.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:56.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:56.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:56.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:56.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:57.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:57.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:57.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:57.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:57.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:57.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:58.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:58.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:59.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:09:59.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:09:59.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:09:59.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:00.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:00.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:00.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:00.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:00.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:00.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:00.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:00.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:01.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:01.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:01.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:01.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:02.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:02.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:02.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:02.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:03.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:03.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:03.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:03.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:04.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:04.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:05.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:05.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:05.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:05.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:06.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:06.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:06.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:06.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:07.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:07.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:07.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:07.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:08.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:08.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:08.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:08.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:09.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:08.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:09.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:09.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:09.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:09.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:10.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:10.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:10.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:10.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:11.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:11.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:11.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:11.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:12.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:12.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:12.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:12.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:13.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:13.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:13.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:13.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:14.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:14.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:14.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:14.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:15.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:15.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:15.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:15.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:16.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:16.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:16.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:16.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:17.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:17.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:18.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:18.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:18.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:18.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:19.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:19.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:19.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:19.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:20.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:20.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:20.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:20.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:21.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:21.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:21.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:21.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:21.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:21.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:22.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:22.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:22.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:22.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:23.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:23.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:23.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:23.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:24.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:24.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:24.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:24.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:25.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:25.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:26.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:26.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:26.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:26.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:26.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:26.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:27.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:27.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:28.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:28.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:28.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:28.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:29.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:29.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:29.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:29.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:30.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:30.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:30.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:30.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:30.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:30.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:31.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:31.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:31.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:31.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:32.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:32.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:32.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:32.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:33.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:33.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:33.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:33.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:34.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:34.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:34.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:34.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:35.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:35.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:35.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:35.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:36.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:36.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:37.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:37.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:37.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:37.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:38.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:38.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:38.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:38.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:39.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:39.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:39.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:39.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:40.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:40.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:40.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:40.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:41.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:41.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:41.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:41.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:42.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:42.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:42.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:42.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:43.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:43.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:43.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:43.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:44.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:44.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:44.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:44.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:45.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:45.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:45.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:45.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:46.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:46.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:46.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:46.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:47.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:47.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:47.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:47.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:48.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:48.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:48.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:48.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:49.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:49.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:49.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:49.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:49.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:49.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:50.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:50.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:51.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:51.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:51.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:51.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:51.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:51.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:52.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:52.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:53.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:53.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:53.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:53.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:54.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:54.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:54.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:54.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:54.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:54.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:55.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:55.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:55.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:55.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:56.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:56.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:56.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:56.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:57.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:57.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:58.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:58.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:58.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:58.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:58.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:58.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:59.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:10:59.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:10:59.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:10:59.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:00.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:00.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:00.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:00.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:01.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:01.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:01.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:01.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:02.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:02.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:02.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:02.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:03.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:03.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:03.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:03.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:04.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:04.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:05.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:05.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:05.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:05.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:05.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:05.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:06.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:06.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:07.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:07.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:07.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:07.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:08.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:08.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:08.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:08.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:09.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:09.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:09.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:09.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:10.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:10.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:10.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:10.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:11.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:11.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:11.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:11.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:12.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:12.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:12.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:12.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:13.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:13.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:13.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:13.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:14.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:14.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:14.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:14.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:15.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:15.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:15.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:15.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:16.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:16.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:16.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:16.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:17.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:17.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:17.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:17.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:18.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:18.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:18.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:18.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:19.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:19.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:19.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:19.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:20.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:20.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:20.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:20.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:21.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:21.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:21.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:21.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:22.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:22.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:22.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:22.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:23.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:23.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:23.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:23.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:24.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:24.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:24.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:24.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:25.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:25.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:25.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:25.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:26.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:26.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:26.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:26.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:27.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:27.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:27.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:27.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:28.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:28.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:28.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:28.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:29.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:29.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:29.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:29.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:30.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:30.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:30.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:30.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:31.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:31.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:31.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:31.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:32.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:32.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:32.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:32.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:33.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:33.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:33.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:33.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:34.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:34.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:34.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:34.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:35.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:35.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:35.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:35.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:36.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:36.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:36.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:36.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:37.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:37.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:37.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:37.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:38.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:38.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:38.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:38.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:39.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:39.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:39.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:39.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:40.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:40.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:40.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:40.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:41.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:41.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:41.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:41.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:42.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:42.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:42.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:42.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:43.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:43.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:43.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:43.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:44.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:44.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:44.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:44.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:45.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:45.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:45.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:45.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:46.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:46.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:46.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:46.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:47.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:47.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:47.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:47.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:48.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:48.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:48.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:48.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:49.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:49.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:49.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:49.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:50.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:50.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:50.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:50.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:51.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:51.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:51.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:51.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:52.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:52.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:52.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:52.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:53.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:53.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:53.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:53.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:54.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:54.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:54.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:54.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:55.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:55.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:55.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:55.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:56.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:56.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:56.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:56.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:57.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:57.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:57.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:57.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:58.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:58.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:58.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:58.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:59.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:11:59.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:11:59.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:11:59.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:00.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:00.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:00.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:00.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:01.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:01.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:01.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:01.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:02.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:02.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:02.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:02.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:03.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:03.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:03.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:03.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:04.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:04.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:04.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:04.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:05.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:05.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:05.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:05.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:06.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:06.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:06.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:06.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:07.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:07.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:08.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:08.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:08.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:08.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:09.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:09.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:09.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:09.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:10.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:10.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:10.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:10.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:11.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:11.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:11.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:11.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:12.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:12.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:12.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:12.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:13.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:13.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:13.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:13.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:14.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:14.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:14.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:14.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:15.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:15.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:15.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:15.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:16.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:16.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:16.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:16.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:17.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:17.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:17.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:17.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:18.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:18.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:18.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:18.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:19.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:19.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:19.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:19.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:20.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:20.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:20.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:20.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:21.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:21.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:21.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:21.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:22.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:22.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:22.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:22.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:23.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:23.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:23.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:23.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:24.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:24.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:24.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:24.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:25.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:25.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:25.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:25.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:26.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:26.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:26.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:26.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:27.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:27.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:27.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:27.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:28.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:28.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:28.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:28.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:29.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:29.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:29.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:29.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:30.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:30.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:30.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:30.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:31.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:31.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:31.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:31.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:32.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:32.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:32.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:32.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:33.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:33.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:33.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:33.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:34.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:34.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:34.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:34.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:35.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:35.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:35.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:35.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:36.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:36.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:36.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:36.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:37.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:37.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:37.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:37.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:38.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:38.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:38.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:38.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:39.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:39.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:39.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:39.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:40.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:40.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:40.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:40.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:41.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:41.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:41.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:41.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:42.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:42.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:42.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:42.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:43.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:43.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:43.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:43.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:44.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:44.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:44.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:44.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:45.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:45.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:45.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:45.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:46.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:46.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:46.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:46.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:47.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:47.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:47.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:47.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:48.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:48.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:48.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:48.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:49.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:49.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:49.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:49.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:50.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:50.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:50.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:50.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:51.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:51.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:51.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:51.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:52.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:52.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:52.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:52.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:53.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:53.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:53.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:53.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:54.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:54.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:54.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:54.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:55.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:55.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:55.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:55.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:56.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:56.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:56.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:56.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:57.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:57.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:57.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:57.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:58.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:58.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:58.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:58.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:59.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:12:59.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:12:59.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:12:59.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:00.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:00.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:00.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:00.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:01.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:01.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:01.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:01.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:02.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:02.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:02.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:02.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:03.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:03.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:03.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:03.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:04.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:04.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:04.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:04.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:05.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:05.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:05.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:05.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:06.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:06.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:06.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:06.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:07.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:07.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:07.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:07.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:08.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:08.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:08.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:08.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:09.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:09.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:09.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:09.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:10.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:10.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:10.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:10.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:11.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:11.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:11.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:11.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:12.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:12.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:12.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:12.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:13.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:13.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:13.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:13.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:14.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:14.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:14.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:14.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:15.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:15.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:15.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:15.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:16.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:16.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:16.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:16.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:17.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:17.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:17.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:17.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:18.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:18.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:18.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:18.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:19.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:19.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:19.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:19.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:20.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:20.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:20.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:20.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:21.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:21.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:21.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:21.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:22.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:22.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:22.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:22.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:23.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:23.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:23.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:23.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:24.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:24.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:24.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:24.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:25.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:25.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:25.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:25.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:26.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:26.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:26.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:26.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:27.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:27.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:27.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:27.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:28.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:28.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:28.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:28.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:29.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:29.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:29.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:29.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:30.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:30.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:30.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:30.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:31.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:31.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:31.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:31.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:32.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:32.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:32.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:32.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:33.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:33.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:33.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:33.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:34.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:34.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:34.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:34.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:35.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:35.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:35.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:35.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:36.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:36.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:36.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:36.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:37.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:37.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:37.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:37.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:38.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:38.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:38.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:38.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:39.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:39.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:39.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:39.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:40.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:40.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:40.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:40.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:41.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:41.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:41.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:41.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:42.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:42.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:42.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:42.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:43.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:43.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:43.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:43.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:44.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:44.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:44.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:44.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:45.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:45.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:45.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:45.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:46.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:46.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:46.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:46.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:47.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:47.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:47.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:47.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:48.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:48.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:48.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:48.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:49.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:49.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:49.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:49.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:50.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:50.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:50.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:50.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:50.532 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T23:13:50.529+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac125ae0 msgr2=0x7f81ac0ca6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T23:13:50.534 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T23:13:50.532+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac14ca60 msgr2=0x7f81ac053db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T23:13:50.536 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-22T23:13:50.534+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac125ae0 msgr2=0x7f81ac0ca6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-22T23:13:51.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:51.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:51.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:51.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:52.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:52.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:52.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:52.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:53.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:53.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:53.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:53.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:54.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:54.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:54.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:54.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:55.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:55.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:55.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:55.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:56.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:56.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:56.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:56.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:57.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:57.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:57.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:57.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:58.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:58.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:58.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:58.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:59.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:13:59.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:13:59.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:13:59.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:00.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:00.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:00.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:00.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:01.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:01.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:01.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:01.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:01.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:01.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:02.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:02.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:03.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:03.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:03.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:03.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:03.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:03.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:04.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:04.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:05.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:05.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:05.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:05.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:06.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:06.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:06.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:06.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:07.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:07.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:07.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:07.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:08.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:08.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:08.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:08.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:09.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:09.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:09.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:09.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:10.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:10.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:10.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:10.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:11.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:11.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:11.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:11.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:11.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:11.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:12.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:12.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:12.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:12.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:13.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:13.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:14.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:14.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:14.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:14.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:14.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:14.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:15.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:15.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:16.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:16.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:16.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:16.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:16.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:16.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:17.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:17.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:18.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:18.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:18.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:18.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:18.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:18.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:19.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:19.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:19.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:19.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:20.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:20.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:20.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:20.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:21.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:21.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:21.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:21.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:22.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:22.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:22.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:22.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:23.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:23.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:23.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:23.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:24.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:24.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:25.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:25.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:25.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:25.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:26.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:26.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:26.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:26.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:27.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:27.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:27.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:27.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:28.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:28.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:28.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:28.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:29.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:29.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:29.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:29.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:30.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:30.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:30.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:30.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:31.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:31.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:31.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:31.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:32.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:32.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:32.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:32.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:33.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:33.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:33.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:33.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:34.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:34.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:34.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:34.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:35.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:35.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:35.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:35.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:36.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:36.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:36.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:36.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:37.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:37.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:37.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:37.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:38.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:38.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:38.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:38.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:39.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:39.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:39.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:39.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:40.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:40.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:40.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:40.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:41.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:41.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:41.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:41.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:42.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:42.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:42.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:42.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:43.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:43.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:43.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:43.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:44.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:44.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:44.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:44.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:44.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:44.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:45.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:45.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:45.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:45.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:46.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:46.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:46.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:46.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:47.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:47.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:47.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:47.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:48.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:48.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:48.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:48.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:49.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:49.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:49.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:49.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:50.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:50.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:50.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:50.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:51.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:51.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:51.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:51.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:52.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:52.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:53.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:53.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:53.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:53.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:53.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:53.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:54.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:54.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:54.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:54.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:55.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:55.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:55.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:55.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:56.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:56.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:56.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:56.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:57.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:57.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:57.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:57.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:58.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:58.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:58.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:58.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:59.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:14:59.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:14:59.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:14:59.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:00.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:00.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:01.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:01.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:01.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:01.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:02.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:02.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:02.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:02.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:03.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:03.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:03.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:03.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:04.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:04.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:04.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:04.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:05.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:05.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:05.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:05.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:06.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:06.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:06.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:06.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:07.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:07.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:07.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:07.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:08.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:08.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:08.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:08.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:09.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:09.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:09.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:09.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:10.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:10.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:10.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:10.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:11.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:11.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:11.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:11.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:12.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:12.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:12.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:12.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:13.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:13.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:13.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:13.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:13.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:13.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:14.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:14.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:15.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:15.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:15.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:15.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:16.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:16.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:16.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:16.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:17.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:17.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:17.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:17.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:18.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:18.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:18.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:18.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:18.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:18.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:19.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:19.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:20.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:20.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:20.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:20.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:21.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:21.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:21.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:21.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:22.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:22.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:22.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:22.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:23.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:23.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:23.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:23.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:24.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:24.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:24.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:24.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:25.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:25.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:25.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:25.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:26.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:26.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:26.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:26.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:27.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:27.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:27.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:27.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:28.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:28.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:28.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:28.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:29.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:29.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:29.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:29.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:30.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:30.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:30.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:30.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:31.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:31.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:31.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:31.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:32.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:32.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:32.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:32.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:33.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:33.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:33.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:33.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:33.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:33.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:34.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:34.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:35.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:34.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:35.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:35.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:36.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:36.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:36.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:36.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:37.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:37.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:37.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:37.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:38.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:38.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:38.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:38.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:39.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:39.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:39.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:39.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:39.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:39.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:40.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:40.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:40.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:40.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:41.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:41.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:41.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:41.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:42.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:42.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:42.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:42.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:43.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:43.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:43.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:43.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:44.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:44.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:45.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:45.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:45.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:45.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:46.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:46.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:46.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:46.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:47.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:47.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:47.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:47.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:48.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:48.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:48.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:48.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:48.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:48.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:49.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:49.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:49.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:49.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:50.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:50.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:50.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:50.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:51.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:51.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:51.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:51.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:52.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:52.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:52.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:52.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:53.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:53.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:53.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:53.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:54.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:54.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:54.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:54.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:55.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:55.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:55.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:55.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:56.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:56.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:56.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:56.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:57.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:57.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:57.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:57.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:58.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:58.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:59.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:59.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:59.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:15:59.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:15:59.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:15:59.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:00.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:00.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:00.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:00.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:01.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:01.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:01.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:01.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:02.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:02.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:02.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:02.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:03.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:03.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:03.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:03.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:04.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:04.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:04.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:04.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:05.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:05.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:05.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:05.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:06.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:06.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:06.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:06.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:07.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:07.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:07.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:07.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:08.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:08.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:08.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:08.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:09.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:09.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:09.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:09.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:10.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:10.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:10.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:10.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:11.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:11.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:11.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:11.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 102 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:12.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:12.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:12.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:12.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:13.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:13.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:13.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:13.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:14.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:14.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:14.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:14.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:15.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:15.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:15.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:15.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:16.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:16.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:16.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:16.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:17.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:17.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:17.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:17.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:18.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:18.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:18.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:18.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:19.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:19.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:19.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:19.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:20.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:20.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:20.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:20.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:21.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:21.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:21.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:21.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:22.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:22.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:22.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:22.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:23.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:23.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:23.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:23.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:24.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:24.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:24.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:24.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:25.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:25.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:25.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:25.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:26.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:26.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:26.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:26.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:27.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:27.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:27.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:27.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:28.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:28.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:28.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:28.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:29.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:29.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:30.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:30.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:30.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:30.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:31.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:31.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:31.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:31.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:32.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:32.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:32.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:32.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:33.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:33.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:33.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:33.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:34.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:34.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:34.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:34.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:35.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:35.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:35.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:35.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:36.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:36.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:36.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:36.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:37.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:37.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:37.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:37.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:38.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:38.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:38.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:38.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:39.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:39.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:39.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:39.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:40.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:40.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:40.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:40.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:41.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:41.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:41.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:41.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:42.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:42.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 89 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:42.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:42.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:42.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:42.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:43.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:43.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:43.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:43.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:44.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:44.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:44.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:44.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:45.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:45.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:45.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:45.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:46.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:46.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:46.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:46.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:47.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:47.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:48.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:48.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:48.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:48.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:49.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:49.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:49.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:49.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:50.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:50.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:50.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:50.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:51.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:51.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:51.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:51.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:52.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:52.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:52.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:52.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:53.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:52.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:53.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:53.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:54.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:54.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:54.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:54.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:55.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:55.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:55.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:55.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:56.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:56.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:56.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:56.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:57.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:57.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:57.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:57.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:57.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:57.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:58.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:58.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:58.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:16:58.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:16:59.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:16:59.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:00.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:00.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:00.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:00.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:01.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:01.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:01.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:01.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:02.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:02.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:02.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:02.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:03.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:03.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:03.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:03.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:04.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:04.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:04.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:04.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:04.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:04.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:05.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:05.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:06.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:06.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:06.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:06.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:07.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:07.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:07.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:07.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:08.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:08.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:08.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:08.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:09.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:09.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:09.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:09.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:10.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:10.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:10.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:10.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:11.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:11.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:11.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:11.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:12.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:12.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:12.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:12.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:13.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:13.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:13.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:13.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:14.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:14.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:14.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:14.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:15.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:15.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:15.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:15.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:16.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:16.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:16.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:16.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:17.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:17.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:17.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:17.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:17.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:17.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:18.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:18.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:18.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:18.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:19.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:19.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:19.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:19.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:20.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:20.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:20.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:20.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:21.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:21.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:22.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:22.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:22.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:22.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:22.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:22.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:23.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:23.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:24.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:24.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:24.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:24.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:24.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:24.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:25.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:25.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:25.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:25.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:26.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:26.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:26.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:26.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:27.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:27.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:28.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:27.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:28.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:28.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:29.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:29.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:29.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:29.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:29.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:29.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:30.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:30.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:31.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:31.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:31.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:31.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:31.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:31.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:32.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:32.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:32.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:32.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:33.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:33.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:33.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:33.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:34.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:34.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:34.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:34.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:35.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:35.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:35.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:35.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:36.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:36.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:36.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:36.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:37.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:37.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:37.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:37.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:38.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:38.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:38.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:38.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:39.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:39.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:39.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:39.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:40.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:40.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:40.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:40.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:41.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:41.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:41.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:41.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:42.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:42.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:42.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:42.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:43.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:43.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:43.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:43.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:44.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:44.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:44.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:44.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:45.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:45.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:45.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:45.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:46.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:46.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:46.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:46.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:47.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:47.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:47.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:47.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:48.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:48.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:48.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:48.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:49.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:49.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:49.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:49.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:50.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:50.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:50.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:50.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:51.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:51.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:51.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:51.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:52.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:52.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:52.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:52.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:53.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:53.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:53.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:53.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:54.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:54.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:54.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:54.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:55.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:55.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:55.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:55.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:56.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:56.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:56.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:56.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:57.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:57.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:57.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:57.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:58.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:58.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:58.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:58.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:59.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:17:59.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:17:59.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:17:59.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:00.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:00.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:00.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:00.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:01.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:01.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:01.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:01.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:02.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:02.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:02.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:02.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:03.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:03.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:03.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:03.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:04.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:04.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:04.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:04.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:05.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:05.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:05.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:05.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:06.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:06.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:06.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:06.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:07.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:07.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:08.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:08.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:08.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:08.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:09.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:09.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:09.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:09.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:10.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:10.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:10.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:10.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:11.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:11.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:11.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:11.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:12.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:12.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:12.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:12.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:13.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:13.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:13.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:13.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:14.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:14.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:14.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:14.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:15.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:15.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:15.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:15.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:16.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:16.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:16.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:16.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:17.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:17.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:17.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:17.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:18.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:18.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:18.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:18.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:19.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:19.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:19.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:19.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:20.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:20.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:20.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:20.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:21.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:21.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:21.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:21.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:22.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:22.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:22.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:22.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:23.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:23.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:23.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:23.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:24.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:24.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:24.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:24.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:25.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:25.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:25.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:25.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:26.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:26.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:26.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:26.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:27.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:27.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:27.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:27.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:28.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:28.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:28.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:28.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:29.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:29.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:29.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:29.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:30.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:30.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:30.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:30.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:31.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:31.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:31.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:31.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:32.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:32.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:32.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:32.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:33.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:33.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:33.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:33.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:34.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:34.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:34.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:34.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:35.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:35.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:35.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:35.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:36.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:36.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:36.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:36.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:37.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:37.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:37.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:37.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:38.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:38.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:38.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:38.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:39.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:39.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:39.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:39.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:40.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:40.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:40.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:40.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:41.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:41.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:41.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:41.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:42.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:42.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:42.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:42.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:43.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:43.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:43.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:43.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:44.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:44.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:44.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:44.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:45.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:45.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:45.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:45.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:46.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:46.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:46.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:46.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:47.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:47.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:47.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:47.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:48.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:48.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:48.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:48.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:49.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:49.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:49.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:49.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:50.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:50.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:50.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:50.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:51.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:51.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:51.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:51.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:52.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:52.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:52.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:52.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:53.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:53.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:53.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:53.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:54.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:54.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:54.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:54.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:55.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:55.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:55.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:55.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:56.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:56.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:56.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:56.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:57.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:57.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:57.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:57.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:58.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:58.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:58.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:58.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:59.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:18:59.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:18:59.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:18:59.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:00.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:00.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:00.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:00.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:01.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:01.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:01.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:01.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:02.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:02.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:02.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:02.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:03.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:03.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:03.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:03.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:04.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:04.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:04.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:04.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:05.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:05.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:05.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:05.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:06.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:06.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:06.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:06.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:07.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:07.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:07.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:07.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:08.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:08.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:09.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:09.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:09.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:09.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:10.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:10.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:10.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:10.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:11.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:11.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:11.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:11.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:12.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:12.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:12.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:12.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:13.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:13.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:13.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:13.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:14.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:14.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:14.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:14.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:15.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:15.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:15.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:15.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:16.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:16.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:16.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:16.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:17.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:17.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:17.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:17.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:18.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:18.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:18.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:18.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:19.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:19.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:19.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:19.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:20.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:20.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:20.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:20.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:21.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:21.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:21.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:21.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:22.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:22.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:22.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:22.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:23.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:23.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:23.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:23.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:24.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:24.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:24.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:24.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:24.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:24.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:25.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:25.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:26.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:26.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:26.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:26.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:26.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:26.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:27.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:27.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:27.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:27.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:28.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:28.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:28.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:28.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:29.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:29.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:29.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:29.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:30.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:30.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:30.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:30.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:31.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:31.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:32.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:32.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:32.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:32.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:33.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:33.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:33.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:33.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:33.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:33.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:34.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:34.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:34.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:34.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:35.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:35.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:35.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:35.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:36.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:36.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:36.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:36.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:37.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:37.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:37.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:37.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:38.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:38.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:38.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:38.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:39.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:39.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:39.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:39.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:40.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:40.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:41.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:41.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:41.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:41.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:41.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:41.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:42.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:42.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:42.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:42.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:43.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:43.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:43.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:43.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:44.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:44.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:44.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:44.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:45.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:45.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:45.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:45.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:46.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:46.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:46.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:46.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:47.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:47.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:47.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:47.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:48.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:48.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:49.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:49.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:49.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:49.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:50.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:50.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:50.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:50.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:51.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:51.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:51.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:51.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:52.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:52.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:52.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:52.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:53.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:53.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:53.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:53.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:54.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:54.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:54.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:54.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:55.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:55.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:55.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:55.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:56.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:56.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:56.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:56.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:57.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:57.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:57.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:57.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:58.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:58.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:58.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:58.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:59.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:19:59.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:19:59.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:19:59.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:00.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:00.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:00.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:00.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:01.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:01.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:01.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:01.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:02.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:02.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:02.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:02.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:03.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:03.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:03.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:03.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:04.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:04.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:04.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:04.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:05.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:05.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:05.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:05.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:06.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:06.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:06.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:06.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:07.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:07.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:07.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:07.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:08.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:08.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:08.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:08.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:09.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:09.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:09.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:09.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:10.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:10.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:10.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:10.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:11.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:11.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:11.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:11.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:12.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:12.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:12.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:12.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:13.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:13.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:13.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:13.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:13.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:13.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:14.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:14.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:14.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:14.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:15.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:15.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:15.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:15.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:16.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:16.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:16.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:16.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:17.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:17.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:17.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:17.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:18.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:18.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:18.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:18.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:19.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:19.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:19.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:19.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:20.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:20.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:20.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:20.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:21.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:21.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:21.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:21.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:22.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:22.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:22.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:22.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:23.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:23.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:23.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:23.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:24.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:24.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:25.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:25.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:25.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:25.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:25.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:25.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:26.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:26.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:26.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:26.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:27.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:27.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:27.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:27.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:28.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:28.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:28.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:28.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:29.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:29.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:30.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:30.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:30.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:30.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:31.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:31.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:31.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:31.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:31.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:31.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:32.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:32.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:32.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:32.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:33.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:33.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:33.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:33.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:34.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:34.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:34.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:34.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:35.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:35.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:35.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:35.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:36.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:36.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:36.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:36.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:37.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:37.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:37.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:37.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:38.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:38.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:39.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:39.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:39.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:39.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:40.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:40.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:40.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:40.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:41.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:41.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:41.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:41.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:42.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:42.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:42.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:42.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:43.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:43.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:43.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:43.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:44.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:44.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:44.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:44.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:45.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:45.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:45.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:45.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:46.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:46.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:46.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:46.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:46.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:46.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:47.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:47.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:47.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:47.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:48.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:48.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:48.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:48.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:49.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:49.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:49.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:49.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:50.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:50.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:50.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:50.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:51.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:51.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:51.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:51.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:52.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:52.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:52.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:52.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:53.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:53.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:53.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:53.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:54.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:54.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:54.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:54.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:55.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:55.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:55.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:55.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:56.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:56.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:56.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:56.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:57.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:57.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:57.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:57.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:58.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:58.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:58.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:58.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:59.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:20:59.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:20:59.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:20:59.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:00.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:00.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:00.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:00.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:01.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:01.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:01.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:01.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:02.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:02.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:02.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:02.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:03.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:03.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:03.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:03.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:04.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:04.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:04.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:04.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:05.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:05.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:05.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:05.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:06.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:06.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:06.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:06.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:07.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:07.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:07.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:07.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:08.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:08.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:08.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:08.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:09.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:09.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:09.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:09.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:10.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:10.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:10.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:10.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:11.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:11.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:11.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:11.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:12.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:12.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:12.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:12.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:13.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:13.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:13.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:13.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:14.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:14.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:14.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:14.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:15.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:15.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:15.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:15.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:16.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:16.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:16.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:16.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:17.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:17.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:17.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:17.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:18.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:18.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:18.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:18.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:19.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:19.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:19.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:19.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:20.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:20.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:20.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:20.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:21.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:21.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:21.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:21.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:22.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:22.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:22.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:22.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:23.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:23.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:23.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:23.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:24.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:24.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:24.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:24.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:25.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:25.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:25.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:25.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:26.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:26.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:26.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:26.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:27.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:27.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:27.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:27.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:28.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:28.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:28.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:28.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:29.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:29.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:29.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:29.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:30.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:30.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:30.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:30.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:31.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:31.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:31.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:31.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:32.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:32.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:32.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:32.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:33.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:33.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:33.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:33.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:34.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:34.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:34.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:34.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:35.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:35.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:35.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:35.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:35.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:35.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:36.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:36.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:36.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:36.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:37.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:37.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:37.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:37.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:38.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:38.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:38.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:38.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:39.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:39.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:40.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:39.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:40.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:40.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:40.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:40.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:41.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:41.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:41.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:41.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:42.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:42.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:42.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:42.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:43.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:43.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:43.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:43.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:44.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:44.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:44.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:44.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:45.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:45.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:46.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:46.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:46.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:46.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:47.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:47.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:47.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:47.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:48.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:48.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:48.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:48.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:49.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:49.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:49.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:49.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:49.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:49.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:50.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:50.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:50.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:50.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:51.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:51.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:51.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:51.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:52.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:52.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:52.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:52.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:53.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:53.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:53.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:53.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:54.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:54.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:54.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:54.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:55.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:55.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:55.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:55.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:56.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:56.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:56.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:56.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:57.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:57.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:57.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:57.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:58.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:58.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:58.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:58.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:59.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:21:59.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:21:59.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:21:59.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:00.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:00.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:01.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:01.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:01.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:01.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:02.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:02.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:02.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:02.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:02.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:02.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:03.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:03.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:04.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:03.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:04.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:04.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:05.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:05.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:05.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:05.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:06.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:06.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:06.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:06.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:07.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:07.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:07.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:07.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:08.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:08.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:08.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:08.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:09.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:09.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:09.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:09.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:10.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:10.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:10.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:10.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:11.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:11.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:11.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:11.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:12.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:12.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:12.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:12.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:13.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:13.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:13.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:13.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:14.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:14.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:14.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:14.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:15.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:15.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:15.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:15.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:16.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:16.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:16.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:16.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:17.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:17.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:17.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:17.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:18.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:18.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:18.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:18.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:19.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:19.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:19.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:19.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:20.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:20.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:20.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:20.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:21.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:21.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:21.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:21.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:22.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:22.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:22.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:22.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:23.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:23.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:23.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:23.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:24.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:24.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:24.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:24.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:25.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:25.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:25.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:25.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:26.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:26.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:26.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:26.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:27.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:27.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:27.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:27.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:28.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:28.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:28.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:28.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:29.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:29.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:29.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:29.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:30.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:30.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:30.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:30.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:31.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:31.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:31.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:31.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:32.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:32.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:32.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:32.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:33.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:33.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:33.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:33.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:34.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:34.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:34.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:34.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:35.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:35.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:35.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:35.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:36.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:36.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:36.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:36.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:37.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:37.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:37.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:37.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:38.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:38.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:38.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:38.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:39.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:39.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:39.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:39.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:40.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:40.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:41.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:41.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:41.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:41.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:42.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:42.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:42.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:42.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:43.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:43.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:43.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:43.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:44.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:44.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:44.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:44.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:45.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:45.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:45.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:45.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:46.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:46.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:46.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:46.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:47.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:47.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:47.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:47.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:48.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:48.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:48.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:48.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:49.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:49.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:49.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:49.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:50.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:50.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:50.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:50.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:51.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:51.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:51.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:51.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:52.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:52.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:52.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:52.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:53.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:53.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:53.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:53.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:54.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:54.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:54.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:54.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:55.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:55.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:55.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:55.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:56.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:56.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:56.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:56.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:57.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:57.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:57.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:57.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:58.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:58.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:58.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:58.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:59.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:22:59.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:22:59.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:22:59.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:00.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:00.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:00.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:00.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:01.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:01.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:01.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:01.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:02.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:02.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:02.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:02.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:03.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:03.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:03.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:03.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:04.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:04.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:04.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:04.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:05.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:05.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:05.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:05.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:06.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:06.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:06.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:06.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:07.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:07.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:07.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:07.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:08.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:08.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:08.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:08.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:09.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:09.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:09.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:09.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:10.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:10.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:10.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:10.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:11.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:11.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:11.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:11.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:12.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:12.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:12.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:12.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:13.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:13.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:13.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:13.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:14.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:14.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:14.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:14.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:15.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:15.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:15.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:15.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:16.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:16.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:16.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:16.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:17.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:17.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:17.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:17.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:18.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:18.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:18.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:18.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:19.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:19.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:19.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:19.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:20.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:20.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:20.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:20.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:21.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:21.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:21.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:21.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:22.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:22.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:22.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:22.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:23.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:23.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:23.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:23.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:24.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:24.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:24.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:24.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:25.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:25.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:25.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:25.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:26.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:26.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:26.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:26.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:27.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:27.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:27.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:27.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:28.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:28.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:28.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:28.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:29.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:29.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:29.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:29.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:30.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:30.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:30.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:30.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:31.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:31.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:31.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:31.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:32.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:32.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:32.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:32.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:33.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:33.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:33.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:33.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:34.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:34.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:34.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:34.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:35.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:35.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:35.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:35.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:36.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:36.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:36.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:36.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:37.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:37.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:37.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:37.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:38.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:38.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:38.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:38.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:39.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:39.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:39.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:39.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:40.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:40.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:40.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:40.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:41.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:41.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:41.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:41.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:42.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:42.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:42.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:42.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:43.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:43.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:43.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:43.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:44.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:44.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:44.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:44.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:45.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:45.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:45.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:45.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:46.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:46.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:46.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:46.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:47.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:47.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:47.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:47.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:48.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:48.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:48.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:48.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:49.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:49.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:49.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:49.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:50.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:50.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:50.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:50.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:51.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:51.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:51.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:51.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:52.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:52.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:52.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:52.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:52.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:52.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:53.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:53.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:53.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:53.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:54.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:54.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:55.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:54.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:55.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:55.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:56.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:56.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:56.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:56.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:57.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:57.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:57.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:57.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:58.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:58.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:58.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:58.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:59.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:23:59.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:23:59.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:23:59.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:00.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:00.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:00.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:00.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:01.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:01.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:01.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:01.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:02.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:02.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:02.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:02.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:03.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:03.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:03.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:03.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:04.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:04.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:04.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:04.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:05.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:05.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:05.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:05.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:05.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:05.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:06.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:06.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:06.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:06.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:07.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:07.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:07.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:07.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:08.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:08.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:08.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:08.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:09.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:09.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:09.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:09.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:10.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:10.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:10.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:10.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:11.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:11.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:11.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:11.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:12.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:12.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:13.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:12.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:13.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:13.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:13.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:13.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:14.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:14.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:14.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:14.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:15.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:15.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:15.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:15.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:16.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:16.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:16.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:16.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:17.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:17.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:17.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:17.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:18.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:18.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:18.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:18.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:19.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:19.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:19.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:19.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:20.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:20.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:20.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:20.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:21.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:21.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:21.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:21.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:22.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:22.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:22.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:22.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:23.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:23.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:23.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:23.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:24.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:24.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:24.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:24.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:25.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:25.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:25.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:25.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:26.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:26.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:26.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:26.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:27.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:27.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:27.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:27.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:28.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:28.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:28.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:28.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:29.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:29.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:29.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:29.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:30.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:30.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:30.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:30.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:31.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:31.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:31.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:31.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:32.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:32.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:32.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:32.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:33.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:33.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:33.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:33.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:34.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:34.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:34.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:34.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:35.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:35.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:35.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:35.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:36.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:36.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:36.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:36.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:37.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:37.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:37.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:37.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:38.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:38.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:38.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:38.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:39.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:39.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:39.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:39.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:40.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:40.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:40.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:40.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:41.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:41.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:41.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:41.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:42.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:42.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:42.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:42.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:43.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:43.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:43.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:43.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:44.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:44.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:44.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:44.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:45.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:45.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:45.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:45.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:46.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:46.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:46.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:46.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:47.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:47.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:47.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:47.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:48.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:48.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:48.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:48.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:49.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:49.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:50.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:50.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:50.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:50.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:51.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:50.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:51.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:51.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:52.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:51.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:52.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:52.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:53.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:53.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:53.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:53.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:54.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:54.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:54.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:54.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:55.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:55.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:55.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:55.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:56.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:56.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:56.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:56.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:57.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:57.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:57.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:57.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:58.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:58.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:58.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:58.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:59.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:24:59.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:24:59.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:24:59.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:00.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:00.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:00.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:00.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:01.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:01.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:01.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:01.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:02.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:02.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:02.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:02.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:03.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:03.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:03.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:03.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:04.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:04.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:04.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:04.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:05.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:05.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:05.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:05.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:06.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:06.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:06.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:06.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:07.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:07.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:07.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:07.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:08.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:08.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:08.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:08.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:09.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:09.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:09.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:09.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:10.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:10.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:10.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:10.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:11.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:11.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:11.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:11.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:12.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:12.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:12.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:12.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:13.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:13.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:13.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:13.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:14.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:14.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:14.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:14.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:15.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:15.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:15.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:15.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:16.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:16.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:16.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:16.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:17.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:17.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:17.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:17.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:18.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:18.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:18.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:18.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:19.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:19.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:19.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:19.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:20.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:20.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:20.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:20.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:21.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:21.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:21.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:21.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:22.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:22.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:22.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:22.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:23.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:23.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:23.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:23.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:24.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:24.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:24.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:24.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:25.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:25.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:25.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:25.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:26.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:26.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:26.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:26.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:27.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:27.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:27.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:27.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:28.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:28.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:28.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:28.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:29.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:29.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:29.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:29.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:30.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:30.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:30.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:30.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:31.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:31.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:31.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:31.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:32.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:31.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:32.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:32.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:33.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:33.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:33.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:33.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:33.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:33.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:34.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:34.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:34.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:34.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:35.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:35.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:35.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:35.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:36.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:36.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:36.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:36.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:37.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:37.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:37.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:37.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:38.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:38.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:38.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:38.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:39.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:39.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:39.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:39.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:40.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:40.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:40.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:40.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:41.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:41.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:41.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:41.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:42.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:42.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:42.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:42.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:43.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:43.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:43.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:43.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:44.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:44.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:44.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:44.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:45.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:45.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:45.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:45.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:46.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:46.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:46.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:46.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:47.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:47.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:47.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:47.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:48.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:48.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:48.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:48.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:49.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:49.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:49.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:49.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:50.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:50.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:50.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:50.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:51.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:51.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:51.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:51.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:52.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:52.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:52.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:52.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:53.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:53.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:53.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:53.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:54.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:54.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:54.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:54.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:55.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:55.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:55.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:55.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:56.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:56.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:56.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:56.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:57.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:57.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:57.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:57.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:58.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:58.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:58.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:58.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:59.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:25:59.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:25:59.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:25:59.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:00.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:00.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:00.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:00.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:01.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:01.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:01.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:01.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:02.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:02.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:02.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:02.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:03.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:03.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:03.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:03.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:04.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:04.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:04.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:04.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:05.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:05.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:05.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:05.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:06.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:06.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:07.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:07.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:07.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:07.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:08.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:08.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:08.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:08.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:09.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:09.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:09.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:09.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:10.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:10.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:10.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:10.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:11.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:11.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:11.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:11.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:12.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:12.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:12.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:12.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:13.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:13.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:13.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:13.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:14.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:14.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:14.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:14.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:15.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:15.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:15.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:15.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:16.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:16.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:16.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:16.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:17.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:17.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:17.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:17.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:18.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:18.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:18.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:18.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:19.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:19.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:19.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:19.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:20.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:20.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:20.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:20.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:21.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:21.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:21.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:21.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:22.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:22.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:22.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:22.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:23.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:23.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:23.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:23.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:24.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:24.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:24.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:24.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:25.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:25.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:25.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:25.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:26.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:26.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:26.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:26.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:27.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:27.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:27.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:27.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:28.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:28.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:28.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:28.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:29.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:29.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:29.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:29.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:30.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:30.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:30.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:30.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:31.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:31.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:31.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:31.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:32.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:32.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:32.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:32.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:33.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:33.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:33.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:33.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:34.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:34.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:34.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:34.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:35.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:35.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:35.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:35.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:36.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:36.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:36.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:36.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:37.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:37.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:37.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:37.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:38.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:38.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:38.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:38.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:39.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:39.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:39.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:39.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:40.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:40.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:40.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:40.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:41.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:41.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:41.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:41.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:42.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:42.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:42.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:42.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:43.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:43.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:43.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:43.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:44.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:44.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:44.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:44.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:45.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:45.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:45.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:45.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:46.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:46.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:46.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:46.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:47.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:47.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:47.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:47.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:48.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:48.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:48.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:48.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:49.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:49.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:49.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:49.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:50.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:50.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:50.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:50.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:51.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:51.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:51.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:51.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:52.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:52.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:52.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:52.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:53.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:53.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:53.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:53.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:54.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:54.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:54.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:54.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:55.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:55.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:55.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:55.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:56.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:56.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:56.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:56.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:57.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:57.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:57.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:57.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:58.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:58.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:58.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:58.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:59.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:26:59.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:26:59.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:26:59.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:00.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:00.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:00.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:00.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:01.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:01.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:01.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:01.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:02.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:02.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:02.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:02.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:03.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:03.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:03.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:03.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:04.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:04.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:04.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:04.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:05.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:05.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:05.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:05.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:06.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:06.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:06.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:06.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:07.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:07.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:07.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:07.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:08.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:08.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:08.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:08.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:09.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:09.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:09.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:09.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:10.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:10.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:10.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:10.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:11.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:11.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:11.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:11.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:12.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:12.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:12.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:12.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:13.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:13.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:13.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:13.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:14.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:14.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:14.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:14.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:15.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:15.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:15.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:15.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:16.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:16.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:16.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:16.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:17.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:17.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:17.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:17.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:18.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:18.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:18.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:18.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:19.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:19.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:19.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:19.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:20.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:20.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:20.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:20.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:21.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:21.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:21.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:21.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:22.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:22.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:22.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:22.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:23.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:23.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:23.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:23.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:24.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:24.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:24.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:24.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:25.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:25.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:25.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:25.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:26.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:26.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:26.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:26.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:27.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:27.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:27.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:27.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:28.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:28.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:28.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:28.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:29.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:29.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:29.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:29.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:30.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:30.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:30.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:30.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:31.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:31.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:31.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:31.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:32.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:32.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:32.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:32.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:33.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:33.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:33.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:33.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:34.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:34.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:34.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:34.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:35.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:35.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:35.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:35.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:36.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:36.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:36.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:36.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:37.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:37.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:37.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:37.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:38.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:38.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:38.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:38.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:39.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:39.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:39.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:39.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:40.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:40.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:40.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:40.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:41.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:41.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:41.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:41.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:42.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:42.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:42.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:42.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:43.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:43.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:43.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:43.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:44.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:44.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:44.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:44.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:45.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:45.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:45.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:45.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:46.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:46.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:46.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:46.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:47.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:47.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:47.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:47.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:48.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:48.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:48.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:48.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:49.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:49.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:49.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:49.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:50.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:50.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:50.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:50.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:51.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:51.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:51.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:51.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:52.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:52.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:52.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:52.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:53.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:53.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:53.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:53.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:54.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:54.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:54.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:54.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:55.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:55.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:55.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:55.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:56.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:56.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:56.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:56.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:57.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:57.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:57.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:57.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:58.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:58.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:58.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:58.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:59.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:27:59.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:27:59.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:27:59.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:00.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:00.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:00.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:00.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:01.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:01.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:01.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:01.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:02.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:02.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:02.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:02.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:03.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:03.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:03.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:03.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:04.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:04.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:04.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:04.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:05.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:05.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:05.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:05.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:06.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:06.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:06.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:06.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:07.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:07.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:07.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:07.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:08.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:08.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:08.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:08.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:09.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:09.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:09.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:09.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:10.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:10.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:10.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:10.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:11.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:11.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:11.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:11.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:12.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:12.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:12.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:12.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:13.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:13.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:13.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:13.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:14.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:14.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:14.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:14.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:15.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:15.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:15.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:15.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:16.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:16.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:16.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:16.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:17.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:17.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:17.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:17.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:18.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:18.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:18.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:18.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:19.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:19.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:19.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:19.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:20.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:20.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:20.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:20.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:21.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:21.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:21.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:21.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:22.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:22.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:22.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:22.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:23.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:23.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:23.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:23.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:24.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:24.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:24.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:24.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:25.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:25.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:25.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:25.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:26.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:26.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:26.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:26.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:27.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:27.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:27.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:27.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:28.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:28.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:28.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:28.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:29.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:29.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:29.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:29.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:30.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:30.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:30.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:30.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:31.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:31.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:31.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:31.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:32.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:32.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:32.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:32.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:33.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:33.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:33.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:33.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:34.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:34.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:34.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:34.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:35.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:35.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:35.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:35.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:36.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:36.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:36.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:36.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:37.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:37.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:37.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:37.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:38.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:38.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:38.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:38.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:39.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:39.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:39.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:39.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:40.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:40.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:40.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:40.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:41.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:41.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:41.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:41.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:42.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:42.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:42.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:42.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:43.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:43.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:43.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:43.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:44.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:44.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:44.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:44.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:45.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:45.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:45.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:45.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:46.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:46.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:46.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:46.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:47.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:47.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:47.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:47.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:48.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:48.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:48.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:48.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:49.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:49.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:49.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:49.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:50.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:50.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:50.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:50.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:51.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:51.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:51.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:51.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:52.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:52.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:52.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:52.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:53.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:53.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:53.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:53.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:54.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:54.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:54.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:54.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:55.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:55.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:55.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:55.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:56.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:56.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:56.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:56.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:57.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:57.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:57.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:57.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:58.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:58.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:58.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:58.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:59.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:28:59.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:28:59.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:28:59.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:00.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:00.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:00.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:00.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:01.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:01.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:01.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:01.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:02.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:02.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:02.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:02.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:03.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:03.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:03.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:03.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:04.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:04.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:04.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:04.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:05.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:05.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:05.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:05.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:06.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:06.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:06.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:06.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:07.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:07.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:07.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:07.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:08.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:08.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:08.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:08.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:09.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:09.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:09.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:09.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:10.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:10.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:10.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:10.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:11.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:11.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:11.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:11.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:12.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:12.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:12.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:12.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:13.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:13.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:13.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:13.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:14.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:14.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:14.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:14.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:15.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:15.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:15.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:15.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:16.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:16.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:16.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:16.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:17.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:17.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:17.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:17.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:18.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:18.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:18.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:18.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:19.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:19.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:19.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:19.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:20.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:20.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:20.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:20.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:21.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:21.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:21.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:21.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:22.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:22.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:22.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:22.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:23.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:23.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:23.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:23.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:24.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:24.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:24.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:24.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:25.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:25.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:25.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:25.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:26.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:26.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:26.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:26.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:27.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:27.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:27.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:27.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:28.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:28.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:28.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:28.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:29.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:29.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:29.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:29.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:30.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:30.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:30.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:30.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:31.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:31.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:31.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:31.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:32.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:32.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:32.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:32.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:33.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:33.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:33.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:33.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:34.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:34.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:34.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:34.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:35.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:35.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:35.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:35.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:36.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:36.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:36.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:36.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:37.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:37.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:37.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:37.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:38.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:38.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:38.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:38.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:39.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:39.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:39.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:39.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:40.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:40.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:40.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:40.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:41.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:41.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:41.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:41.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:42.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:42.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:42.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:42.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:43.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:43.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:43.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:43.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:44.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:44.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:44.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:44.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:45.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:45.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:45.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:45.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:46.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:46.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:46.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:46.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:47.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:47.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:47.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:47.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:48.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:48.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:48.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:48.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:49.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:49.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:50.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:49.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:50.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:50.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:51.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:50.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:51.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:51.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:52.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:52.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:52.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:52.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:53.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:53.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:53.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:53.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:54.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:54.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:54.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:54.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:55.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:55.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:55.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:55.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:56.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:55.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:56.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:56.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:57.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:56.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:57.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:57.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:57.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:57.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:58.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:58.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:59.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:58.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:29:59.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:29:59.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:00.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:29:59.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:00.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:00.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:01.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:01.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:01.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:01.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:02.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:02.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:02.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:02.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:03.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:03.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:03.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:03.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:04.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:04.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:04.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:04.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:05.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:05.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:05.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:05.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:06.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:06.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:06.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:06.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:07.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:07.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:07.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:07.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:08.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:08.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:08.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:08.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:09.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:09.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:09.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:09.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:10.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:10.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:10.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:10.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:11.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:11.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:11.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:11.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:12.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:12.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:12.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:12.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:13.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:13.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:13.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:13.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:14.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:14.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:14.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:14.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:15.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:15.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:15.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:15.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:16.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:16.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:16.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:16.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:17.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:17.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:17.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:17.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:18.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:18.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:18.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:18.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:19.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:19.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:19.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:19.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:20.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:20.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:20.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:20.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:21.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:21.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:21.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:21.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:22.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:22.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:22.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:22.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:23.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:23.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:23.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:23.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:24.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:24.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:24.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:24.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:25.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:25.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:25.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:25.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:26.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:26.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:26.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:26.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:27.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:27.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:27.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:27.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:28.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:28.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:28.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:28.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:29.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:29.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:29.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:29.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:30.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:30.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:30.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:30.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:31.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:31.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:31.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:31.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:32.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:32.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:32.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:32.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:33.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:33.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:33.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:33.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:34.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:34.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:34.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:34.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:35.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:35.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:35.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:35.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:36.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:36.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:36.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:36.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:37.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:37.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:37.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:37.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:38.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:38.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:38.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:38.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:39.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:39.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:39.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:39.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:40.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:40.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:40.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:40.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:41.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:41.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:41.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:41.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:42.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:41.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:42.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:42.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:42.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:42.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:43.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:43.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:43.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:43.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:44.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:44.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:44.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:44.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:45.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:45.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:45.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:45.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:46.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:46.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:46.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:46.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:47.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:47.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:47.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:47.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:48.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:48.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:48.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:48.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:49.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:49.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:49.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:49.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:50.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:50.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:50.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:50.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:51.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:51.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:51.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:51.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:52.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:52.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:52.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:52.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:53.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:53.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:53.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:53.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:54.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:54.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:54.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:54.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:55.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:55.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:56.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:55.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:56.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:56.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:57.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:56.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:57.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:57.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:58.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:58.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:58.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:58.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:59.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:30:58.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:30:59.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:30:59.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:00.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:00.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:00.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:00.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:01.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:01.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:01.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:01.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:02.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:02.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:02.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:02.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:03.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:03.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:03.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:03.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:04.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:04.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:04.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:04.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:05.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:05.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:05.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:05.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:06.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:06.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:06.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:06.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:07.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:06.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:07.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:07.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:07.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:07.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:08.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:08.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:08.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:08.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:09.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:09.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:09.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:09.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:10.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:10.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:10.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:10.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:11.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:11.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:11.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:11.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 105 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:12.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:12.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:12.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:12.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:13.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:13.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:13.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:13.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:14.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:14.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:14.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:14.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:15.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:15.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:15.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:15.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:16.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:16.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:16.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:16.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:17.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:17.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:17.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:17.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:18.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:18.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:18.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:18.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:19.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:19.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:20.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:19.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:20.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:20.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:21.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:20.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:21.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:21.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:22.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:22.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:22.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:22.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:23.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:23.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:23.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:23.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:24.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:24.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:24.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:24.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:25.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:25.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:25.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:25.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:26.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:26.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:26.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:26.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:27.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:27.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:27.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:27.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:28.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:28.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:28.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:28.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:29.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:28.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:29.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:29.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:30.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:30.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:30.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:30.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:31.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:31.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:31.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:31.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:32.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:31.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:32.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:32.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:33.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:32.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:33.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:33.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:34.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:33.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:34.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:34.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:35.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:34.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:35.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:35.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:35.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:35.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:36.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:36.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:37.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:36.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:37.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:37.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:38.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:38.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:38.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:38.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:39.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:39.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:39.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:39.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:40.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:40.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:40.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:40.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:41.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:41.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 47 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:31:41.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:41.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:42.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:42.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:42.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:42.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:43.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:43.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:43.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:43.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:44.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:44.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:44.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:44.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:45.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:45.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:45.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:45.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:46.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:46.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:46.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:46.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:47.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:47.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:47.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:47.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:48.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:48.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:48.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:48.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:49.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:49.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:49.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:49.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:50.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:50.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:50.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:50.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:51.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:51.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:51.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:51.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:52.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:52.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:52.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:52.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:53.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:53.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:53.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:53.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:54.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:54.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:54.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:54.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:55.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:55.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:55.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:55.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:56.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:56.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:56.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:56.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:57.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:57.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:57.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:57.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:58.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:58.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:58.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:58.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:59.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:31:59.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:31:59.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:31:59.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:00.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:00.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:00.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:00.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:01.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:01.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:01.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:01.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:02.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:02.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:02.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:02.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:03.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:03.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:03.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:03.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:04.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:04.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:04.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:04.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:05.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:05.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:05.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:05.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:06.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:06.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:06.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:06.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:07.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:07.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:07.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:07.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:08.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:08.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:08.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:08.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:09.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:09.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:09.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:09.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:10.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:10.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:10.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:10.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:11.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:11.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:11.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:11.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:12.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:12.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:12.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:12.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:13.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:13.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:13.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:13.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:14.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:14.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:14.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:14.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:15.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:15.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:15.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:15.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:16.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:16.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:16.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:16.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:17.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:17.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:17.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:17.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:18.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:18.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:18.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:18.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:19.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:19.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:19.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:19.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:20.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:20.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:20.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:20.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:21.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:21.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:21.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:21.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:22.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:22.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:22.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:22.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:23.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:23.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:23.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:23.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:24.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:24.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:24.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:24.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:25.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:25.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:25.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:25.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:26.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:26.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:26.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:26.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:27.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:27.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:27.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:27.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:28.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:28.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:28.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:28.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:29.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:29.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:29.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:29.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:30.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:30.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:30.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:30.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:31.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:31.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:31.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:31.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:32.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:32.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:32.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:32.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:33.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:33.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:33.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:33.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:34.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:34.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:34.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:34.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:35.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:35.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:35.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:35.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:36.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:36.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:36.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:36.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:37.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:37.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:37.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:37.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:38.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:38.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:38.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:38.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:39.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:39.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:39.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:39.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:40.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:40.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:40.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:40.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:41.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:41.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:41.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:41.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:42.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:42.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:42.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:42.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:43.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:43.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:43.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:43.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:44.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:44.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:44.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:44.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:45.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:45.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:45.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:45.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:46.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:46.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:46.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:46.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:47.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:47.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:47.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:47.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:48.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:48.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:48.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:48.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:49.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:48.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:49.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:49.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:49.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:49.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:50.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:50.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:50.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:50.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:51.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:51.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:51.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:51.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:52.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:52.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:52.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:52.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:53.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:53.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:53.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:53.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:54.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:54.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:54.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:54.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:55.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:55.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:55.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:55.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:56.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:56.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:56.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:56.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:57.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:57.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:57.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:57.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:58.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:58.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:58.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:58.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:59.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:32:59.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:32:59.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:32:59.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:00.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:00.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:00.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:00.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:01.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:01.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:01.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:01.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:02.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:02.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:02.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:02.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:03.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:03.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:03.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:03.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:04.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:04.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:04.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:04.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:05.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:05.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:05.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:05.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:06.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:06.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:06.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:06.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:07.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:07.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:07.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:07.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:08.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:08.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:08.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:08.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:09.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:09.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:09.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:09.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:10.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:10.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:10.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:10.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:11.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:11.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:11.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:11.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:12.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:12.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:12.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:12.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:13.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:13.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:13.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:13.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:14.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:14.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:15.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:14.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:15.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:15.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:15.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:15.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:16.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:16.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:17.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:16.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:17.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:17.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:17.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:17.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:18.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:18.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:18.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:18.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:19.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:19.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:19.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:19.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:20.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:20.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:20.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:20.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:21.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:21.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:21.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:21.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:22.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:22.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:22.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:22.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:23.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:23.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:23.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:23.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:24.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:24.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:24.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:24.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:25.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:25.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:25.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:25.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:26.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:26.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:26.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:26.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:27.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:27.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:27.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:27.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:28.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:28.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:28.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:28.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:29.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:29.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:30.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:29.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:30.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:30.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:31.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:30.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:31.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:31.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:31.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:31.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:32.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:32.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:32.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:32.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:33.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:33.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:33.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:33.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:34.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:34.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:34.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:34.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:35.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:35.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:36.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:35.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:36.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:36.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:36.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:36.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:37.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:37.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:38.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:37.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:38.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:38.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:38.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:38.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:39.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:39.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:40.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:39.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:40.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:40.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:41.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:41.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:41.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:41.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:42.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:42.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:42.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:42.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:43.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:42.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:43.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:43.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:44.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:43.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:44.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:44.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:45.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:44.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:45.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:45.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:46.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:46.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:46.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:46.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:47.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:47.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:47.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:47.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:48.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:48.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:48.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:48.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:49.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:49.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:49.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:49.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:50.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:49.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:50.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:50.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:51.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:50.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:51.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:51.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:52.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:52.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:52.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:52.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:53.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:52.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:53.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:53.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:54.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:54.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:54.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:54.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:55.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:54.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:55.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:55.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:56.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:56.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:56.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:56.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:57.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:56.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:57.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:57.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:58.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:57.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:58.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:58.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:58.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:58.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:59.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:33:59.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:33:59.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:33:59.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:00.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:00.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:00.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:00.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:01.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:01.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:01.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:01.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:02.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:02.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:02.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:02.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:03.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:03.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:03.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:03.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:04.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:04.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:04.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:04.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:05.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:05.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:05.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:05.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:06.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:06.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:06.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:06.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:07.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:07.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:07.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:07.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:08.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:08.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:08.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:08.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:09.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:09.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:09.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:09.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:10.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:10.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:10.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:10.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:11.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:11.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:11.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:11.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:12.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:12.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:13.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:12.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:13.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:13.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:14.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:14.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:14.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:14.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:15.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:14.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:15.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:15.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:16.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:15.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:16.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:16.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:16.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:16.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:17.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:17.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:17.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:17.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:18.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:18.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:18.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:18.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:19.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:19.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:20.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:19.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:20.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:20.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:21.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:21.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:21.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:21.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:22.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:22.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:22.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:22.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:23.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:23.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:23.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:23.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:24.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:24.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:24.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:24.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:25.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:24.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:25.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:25.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:26.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:26.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:26.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:26.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:27.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:26.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:27.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:27.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:28.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:28.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:28.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:28.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:29.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:29.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:29.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:29.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:30.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:29.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:30.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:30.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:31.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:30.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:31.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:31.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:32.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:32.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:32.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:32.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:33.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:33.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:33.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:33.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:34.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:33.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:34.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:34.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:35.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:34.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:35.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:35.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:36.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:36.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:36.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:36.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:37.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:37.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:37.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:37.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:38.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:38.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:38.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:38.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:39.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:39.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:39.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:39.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:40.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:40.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:40.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:40.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:41.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:41.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:41.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:41.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:42.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:42.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:42.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:42.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:43.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:43.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:43.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:43.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:44.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:44.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:44.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:44.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:45.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:45.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:45.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:45.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:46.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:46.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:46.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:46.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:47.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:47.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:47.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:47.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:48.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:48.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:48.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:48.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:49.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:49.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:49.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:49.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:50.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:50.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:50.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:50.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:51.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:51.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:51.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:51.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:52.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:52.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:52.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:52.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:53.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:53.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:53.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:53.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:54.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:54.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:54.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:54.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:55.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:55.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:55.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:55.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:56.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:56.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:56.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:56.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:57.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:57.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:57.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:57.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:58.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:58.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:58.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:58.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:59.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:34:59.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:34:59.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:34:59.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:00.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:00.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:00.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:00.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:01.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:01.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:01.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:01.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:02.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:02.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:02.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:02.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:03.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:03.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:03.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:03.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:04.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:04.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:04.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:04.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:05.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:05.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:05.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:05.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:06.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:06.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:06.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:06.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:07.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:07.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:07.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:07.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:08.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:08.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:08.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:08.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:09.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:09.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:09.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:09.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:10.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:10.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:10.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:10.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:11.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:11.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:11.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:11.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:12.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:12.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:12.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:12.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:13.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:13.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:13.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:13.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:14.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:14.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:14.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:14.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:15.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:15.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:15.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:15.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:16.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:16.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:16.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:16.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:17.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:17.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:17.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:17.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:18.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:18.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:18.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:18.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:19.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:19.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:19.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:19.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:20.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:20.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:20.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:20.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:21.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:21.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:21.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:21.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:22.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:22.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:22.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:22.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:23.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:23.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:23.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:23.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:24.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:24.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:24.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:24.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:25.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:25.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:25.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:25.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:26.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:26.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:26.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:26.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:27.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:27.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:27.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:27.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:28.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:28.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:28.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:28.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:29.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:29.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:29.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:29.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:30.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:30.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:30.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:30.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:31.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:31.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:31.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:31.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:32.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:32.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:32.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:32.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:33.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:33.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:33.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:33.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:34.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:34.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:34.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:34.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:35.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:35.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:35.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:35.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:36.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:36.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:36.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:36.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:37.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:37.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:37.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:37.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:38.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:38.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:38.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:38.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:39.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:39.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:39.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:39.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:40.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:40.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:40.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:40.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:41.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:41.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:41.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:41.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:42.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:42.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:42.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:42.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:43.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:43.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:43.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:43.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:44.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:44.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:44.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:44.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:45.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:45.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:45.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:45.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:46.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:46.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:46.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:46.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:47.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:47.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:47.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:47.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:48.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:48.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:48.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:48.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:49.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:49.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:49.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:49.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:50.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:50.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:50.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:50.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:51.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:51.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:51.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:51.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:52.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:52.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:52.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:52.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:53.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:53.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:53.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:53.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:54.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:54.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:54.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:54.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:55.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:55.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:55.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:55.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:56.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:56.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:56.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:56.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:57.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:57.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:57.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:57.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:58.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:58.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:58.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:58.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:59.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:35:59.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:35:59.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:35:59.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:00.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:00.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:00.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:00.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:01.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:01.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:01.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:01.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:02.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:02.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:02.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:02.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:03.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:03.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:03.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:03.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:04.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:04.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:04.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:04.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:05.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:05.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:05.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:05.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:06.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:06.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:06.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:06.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:07.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:07.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:07.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:07.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:08.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:08.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:08.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:08.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:09.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:09.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:09.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:09.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:10.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:10.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:10.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:10.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:11.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:11.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:11.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:11.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:12.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:12.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:12.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:12.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:13.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:13.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:13.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:13.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:14.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:14.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:14.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:14.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:15.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:15.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:15.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:15.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:16.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:16.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:16.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:16.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:17.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:17.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:17.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:17.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:18.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:18.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:18.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:18.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:19.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:19.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:19.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:19.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:20.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:20.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:20.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:20.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:21.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:21.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:21.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:21.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:22.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:22.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:22.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:22.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:23.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:23.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:23.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:23.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:24.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:24.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:24.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:24.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:25.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:25.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:25.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:25.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:26.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:26.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:26.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:26.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:27.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:27.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:27.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:27.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:28.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:28.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:28.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:28.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:29.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:29.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:29.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:29.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:30.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:30.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:30.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:30.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:31.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:30.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:31.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:31.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:32.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:32.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:32.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:32.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:33.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:32.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:33.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:33.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:34.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:33.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:34.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:34.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:35.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:34.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:35.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:35.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:36.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:36.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:36.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:36.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:37.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:36.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:37.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:37.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:38.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:38.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:38.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:38.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:39.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:39.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:39.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:39.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:40.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:39.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:40.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:40.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:41.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:41.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:41.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:41.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:42.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:42.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:42.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:42.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:43.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:43.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:43.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:43.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:44.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:44.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:44.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:44.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:45.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:45.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:45.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:45.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:46.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:46.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:46.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:46.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:47.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:46.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:47.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:47.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:48.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:47.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:48.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:48.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:49.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:48.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:49.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:49.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:50.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:50.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:50.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:50.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:51.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:51.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:51.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:51.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:52.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:52.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:52.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:52.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:53.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:53.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:53.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:53.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:54.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:54.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:54.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:54.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:55.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:54.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:55.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:55.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:56.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:55.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:56.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:56.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:57.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:57.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:57.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:57.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:58.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:57.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:58.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:58.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:59.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:36:58.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:36:59.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:36:59.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:00.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:00.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:00.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:00.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:01.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:01.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:01.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:01.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:02.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:02.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:02.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:02.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:03.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:02.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:03.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:03.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:04.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:04.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:04.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:04.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:05.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:05.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:05.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:05.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:06.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:06.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:06.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:06.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:07.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:07.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:07.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:07.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:08.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:08.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:08.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:08.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:09.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:09.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:09.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:09.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:10.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:10.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:10.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:10.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:11.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:11.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:11.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:11.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:12.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:12.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:12.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:12.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:13.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:13.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:13.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:13.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:14.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:14.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:14.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:14.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:15.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:15.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:15.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:15.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:16.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:16.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:16.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:16.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:17.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:17.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:17.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:17.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:18.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:18.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:18.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:18.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:19.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:19.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:19.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:19.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:20.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:20.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:20.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:20.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:21.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:21.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:21.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:21.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:22.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:22.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:22.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:22.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:23.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:23.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:23.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:23.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:24.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:24.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:24.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:24.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:25.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:25.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:25.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:25.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:26.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:26.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:26.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:26.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:27.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:27.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:27.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:27.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:28.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:28.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:28.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:28.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:29.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:29.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:29.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:29.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:30.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:30.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:30.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:30.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:31.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:31.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:31.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:31.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:32.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:32.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:32.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:32.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:33.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:33.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:33.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:33.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:34.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:34.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:34.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:34.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:35.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:35.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:35.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:35.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:36.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:36.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:36.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:36.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:37.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:37.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:37.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:37.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:38.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:38.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:38.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:38.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:39.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:39.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:39.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:39.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:40.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:40.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:40.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:40.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:41.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:41.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:41.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:41.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:42.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:42.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:42.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:42.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:43.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:43.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:43.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:43.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:44.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:44.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:44.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:44.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:45.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:45.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:45.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:45.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:46.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:46.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:46.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:46.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:47.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:47.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:47.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:47.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:48.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:48.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:48.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:48.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:49.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:49.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:49.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:49.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:50.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:50.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:50.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:50.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:51.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:51.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:51.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:51.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:52.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:52.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:52.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:52.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:53.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:53.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:53.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:53.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:54.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:54.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:54.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:54.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:55.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:55.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:55.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:55.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:56.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:56.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:56.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:56.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:57.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:57.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:57.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:57.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:58.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:58.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:58.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:58.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:59.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:37:59.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:37:59.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:37:59.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:00.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:00.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:00.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:00.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:01.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:01.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:01.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:01.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:02.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:02.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:02.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:02.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:03.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:03.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:03.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:03.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:04.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:04.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:04.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:04.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:05.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:05.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:05.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:05.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:06.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:06.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:06.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:06.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:07.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:07.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:07.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:07.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:08.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:08.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:08.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:08.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:09.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:09.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:09.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:09.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:10.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:10.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:10.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:10.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:11.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:11.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:11.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:11.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:12.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:12.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:12.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:12.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:13.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:13.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:13.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:13.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:14.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:14.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:14.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:14.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:15.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:15.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:15.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:15.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:16.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:16.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:16.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:16.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:17.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:17.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:17.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:17.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:18.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:18.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:18.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:18.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:19.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:19.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:19.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:19.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:20.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:20.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:20.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:20.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:21.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:21.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:21.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:21.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:22.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:22.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:22.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:22.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:23.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:23.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:23.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:23.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:24.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:24.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:24.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:24.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:25.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:25.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:25.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:25.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:26.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:26.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:26.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:26.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:27.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:27.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:27.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:27.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:28.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:28.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:28.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:28.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:29.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:29.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:29.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:29.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:30.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:30.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:30.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:30.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:31.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:31.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:31.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:31.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:32.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:32.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:32.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:32.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:33.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:33.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:33.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:33.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:34.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:34.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:34.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:34.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:35.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:35.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:35.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:35.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:36.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:36.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:36.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:36.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:37.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:37.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:37.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:37.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:38.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:38.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:38.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:38.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:39.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:39.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:39.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:39.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:40.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:40.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:40.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:40.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:41.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:41.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:41.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:41.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:42.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:42.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:42.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:42.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:43.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:43.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:43.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:43.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:44.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:44.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:44.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:44.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:45.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:45.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:45.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:45.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:46.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:46.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:46.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:46.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:47.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:47.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:47.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:47.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:48.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:48.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:48.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:48.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:49.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:49.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:49.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:49.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:50.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:50.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:50.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:50.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:51.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:51.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:51.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:51.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:52.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:52.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:52.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:52.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:53.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:53.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:53.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:53.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:54.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:54.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:54.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:54.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:55.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:55.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:55.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:55.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:56.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:56.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:56.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:56.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:57.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:57.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:57.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:57.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:58.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:58.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:58.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:58.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:59.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:38:59.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:38:59.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:38:59.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:00.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:00.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:00.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:00.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:01.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:01.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:01.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:01.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:02.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:02.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:02.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:02.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:03.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:03.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:03.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:03.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:04.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:04.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:04.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:04.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:05.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:05.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:05.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:05.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:06.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:06.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:06.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:06.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:07.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:07.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:07.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:07.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:08.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:08.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:08.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:08.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:09.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:09.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:09.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:09.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:10.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:10.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:10.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:10.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:11.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:11.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:11.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:11.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:12.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:12.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:12.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:12.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:13.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:13.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:13.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:13.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:14.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:14.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:14.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:14.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:15.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:15.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:15.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:15.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:16.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:16.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:16.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:16.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:17.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:17.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:17.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:17.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:18.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:18.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:18.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:18.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:19.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:19.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:19.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:19.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:20.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:20.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:20.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:20.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:21.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:21.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:21.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:21.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:22.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:22.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:22.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:22.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:23.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:23.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:23.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:23.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:24.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:24.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:24.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:24.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:25.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:25.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:25.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:25.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:26.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:26.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:26.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:26.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:27.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:27.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:27.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:27.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:28.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:28.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:28.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:28.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:29.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:29.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:29.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:29.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:30.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:30.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:30.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:30.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:31.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:31.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:31.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:31.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:32.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:32.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:32.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:32.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:33.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:33.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:33.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:33.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:34.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:34.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:34.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:34.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:35.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:35.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:35.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:35.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:36.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:36.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:36.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:36.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:37.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:37.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:37.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:37.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:38.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:38.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:38.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:38.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:39.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:39.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:39.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:39.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:40.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:40.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:40.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:40.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:41.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:41.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:41.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:41.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:42.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:42.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:43.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:42.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:43.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:43.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:44.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:44.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:44.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:44.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:45.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:45.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:45.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:45.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:46.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:45.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:46.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:46.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:46.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:46.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:47.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:47.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:48.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:47.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:48.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:48.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:49.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:48.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:49.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:49.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:50.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:49.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:50.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:50.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:51.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:50.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:51.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:51.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:51.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:51.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:52.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:52.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:52.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:52.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:53.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:53.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:54.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:53.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:54.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:54.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:54.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:54.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:55.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:55.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:55.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:55.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:56.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:56.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:57.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:56.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:57.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:57.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:58.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:57.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:58.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:58.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:58.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:58.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:39:59.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:39:59.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:00.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:39:59.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:00.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:00.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:01.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:01.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:01.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:01.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:02.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:02.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:02.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:02.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:03.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:03.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:03.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:03.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:04.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:04.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:05.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:04.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:05.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:05.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:05.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:05.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:06.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:05.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:06.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:06.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:06.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:06.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:07.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:07.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:08.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:07.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:09.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:08.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:09.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:08.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:10.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:09.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:10.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:10.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:11.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:11.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:11.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:11.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:12.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:11.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:12.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:12.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:13.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:13.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:13.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:13.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:14.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:13.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:14.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:14.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:15.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:15.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:15.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:15.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:16.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:16.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:16.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:16.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:17.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:16.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:17.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:17.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:18.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:17.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:18.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:18.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:19.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:18.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:19.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:19.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:19.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:19.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:20.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:20.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:20.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:20.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:21.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:21.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:21.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:21.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:22.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:22.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:22.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:22.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:23.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:23.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:23.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:23.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:24.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:24.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:24.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:24.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:25.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:25.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:25.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:25.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:26.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:26.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:26.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:26.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:27.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:27.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:27.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:27.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:28.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:28.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:28.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:28.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:29.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:29.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:29.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:29.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:30.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:30.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:30.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:30.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:31.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:31.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:31.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:31.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:32.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:32.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:32.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:32.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:33.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:33.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:33.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:33.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:34.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:34.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:34.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:34.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:35.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:35.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:35.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:35.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:36.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:36.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:36.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:36.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:37.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:37.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:37.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:37.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:38.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:38.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:38.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:38.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:39.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:39.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:39.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:39.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:40.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:40.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:40.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:40.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:41.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:41.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:41.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:41.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:42.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:42.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:42.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:42.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:43.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:43.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:43.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:43.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:44.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:44.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:44.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:44.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:45.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:45.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:45.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:45.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:46.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:46.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:46.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:46.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:47.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:47.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:47.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:47.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:48.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:48.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:48.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:48.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:49.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:49.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:49.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:49.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:50.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:50.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:50.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:50.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:51.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:51.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:51.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:51.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:52.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:52.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:52.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:52.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:53.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:53.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:53.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:53.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:54.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:54.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:54.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:54.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:55.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:55.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:55.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:55.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:56.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:56.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:56.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:56.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:57.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:57.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:57.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:57.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:58.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:58.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:58.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:58.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:59.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:40:59.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:40:59.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:40:59.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:00.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:00.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:00.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:00.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:01.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:01.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:01.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:01.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:02.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:02.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:02.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:02.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:03.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:03.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:03.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:03.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:04.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:04.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:04.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:04.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:05.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:05.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:05.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:05.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:06.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:06.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:06.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:06.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:07.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:07.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:07.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:07.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:08.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:08.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:08.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:08.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:09.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:09.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:09.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:09.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:10.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:10.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:10.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:10.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:11.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:11.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:11.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:11.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:12.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:12.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:12.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:12.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:13.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:13.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:13.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:13.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:14.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:14.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:14.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:14.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:15.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:15.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:15.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:15.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:16.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:16.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:16.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:16.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:17.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:17.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:17.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:17.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:18.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:18.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:18.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:18.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:19.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:19.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:19.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:19.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:20.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:20.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:20.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:20.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:21.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:21.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:21.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:21.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:22.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:22.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:22.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:22.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:23.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:23.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:23.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:23.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:24.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:24.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:24.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:24.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:25.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:25.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:25.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:25.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:26.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:26.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:26.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:26.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:27.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:27.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:27.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:27.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:28.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:28.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:28.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:28.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:29.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:29.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:29.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:29.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:30.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:30.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:30.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:30.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:31.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:31.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:31.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:31.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:32.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:32.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:32.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:32.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:33.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:33.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:33.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:33.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:34.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:34.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:34.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:34.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:35.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:35.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:36.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:35.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:36.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:36.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:37.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:36.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:37.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:37.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:38.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:37.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:38.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:38.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:38.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:38.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:39.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:39.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:39.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:39.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:40.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:40.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:40.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:40.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:41.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:41.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:42.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:41.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:42.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:42.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:43.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:42.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:43.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:43.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:44.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:44.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:44.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:44.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:45.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:45.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:45.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:45.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:46.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:46.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:46.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:46.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:47.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:47.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:47.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:47.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:48.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:48.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:48.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:48.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:49.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:49.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:49.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:49.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:50.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:50.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:50.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:50.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:51.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:51.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:51.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:51.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:52.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:51.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:52.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:52.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:53.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:52.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:53.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:53.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:53.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:53.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:54.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:54.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:54.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:54.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:55.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:55.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:55.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:55.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:56.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:56.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:56.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:56.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:57.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:57.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:58.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:57.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:58.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:58.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:59.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:58.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:41:59.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:41:59.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:00.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:41:59.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:00.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:00.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:01.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:01.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:01.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:01.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:02.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:01.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:02.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:02.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:03.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:02.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:03.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:03.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:04.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:03.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:04.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:04.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:05.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:04.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:05.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:05.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:06.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:05.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:06.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:06.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:07.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:06.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:07.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:07.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:08.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:08.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:08.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:08.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:09.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:09.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:09.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:09.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:10.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:10.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:10.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:10.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:11.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:11.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:11.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:11.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:12.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:12.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:12.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:12.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:13.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:13.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:13.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:13.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:14.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:14.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:14.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:14.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:15.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:15.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:15.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:15.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:16.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:16.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:16.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:16.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:17.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:17.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:17.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:17.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:18.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:18.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:18.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:18.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:19.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:19.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:19.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:19.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:20.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:20.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:20.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:20.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:21.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:21.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:21.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:21.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:22.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:22.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:22.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:22.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:23.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:23.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:23.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:23.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:24.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:24.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:24.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:24.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:25.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:25.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:25.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:25.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:26.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:26.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:26.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:26.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:27.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:27.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:27.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:27.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:28.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:28.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:28.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:28.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:29.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:29.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:29.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:29.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:30.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:30.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:30.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:30.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:31.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:31.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:31.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:31.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:32.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:32.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:32.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:32.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:33.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:33.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:33.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:33.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:34.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:34.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:34.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:34.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:35.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:35.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:35.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:35.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:36.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:35.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:36.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:36.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:37.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:36.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:37.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:37.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:38.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:37.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:38.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:38.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:39.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:38.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:39.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:39.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:40.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:39.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:40.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:40.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:41.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:40.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:41.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:41.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:42.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:41.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:42.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:42.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:43.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:42.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:43.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:43.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:44.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:43.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:44.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:44.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:45.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:45.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:45.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:45.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:46.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:45.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:46.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:46.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:47.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:46.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:47.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:47.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:48.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:47.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:48.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:48.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:49.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:48.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:49.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:49.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:50.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:49.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:50.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:50.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:51.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:51.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:51.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:51.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:52.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:52.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:52.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:52.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:53.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:53.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:53.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:53.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:54.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:54.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:54.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:54.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:55.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:55.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:55.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:55.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:56.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:56.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:56.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:56.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:57.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:57.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:57.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:57.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:58.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:58.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:58.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:58.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:59.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:42:59.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:42:59.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:42:59.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:00.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:00.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:00.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:00.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:01.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:01.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:01.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:01.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:02.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:02.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:02.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:02.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:03.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:03.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:03.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:03.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:04.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:04.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:04.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:04.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:05.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:05.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:05.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:05.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:06.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:06.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:06.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:06.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:07.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:07.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:07.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:07.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:08.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:08.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:08.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:08.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:09.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:09.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:09.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:09.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:10.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:10.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:10.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:10.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:11.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:11.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:11.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:11.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:12.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:12.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:12.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:12.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:13.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:13.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:13.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:13.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:14.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:14.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:14.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:14.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:15.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:15.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:15.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:15.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:16.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:16.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:16.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:16.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:17.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:17.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:17.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:17.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:18.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:18.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:18.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:18.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:19.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:19.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:19.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:19.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:20.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:20.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:20.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:20.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:21.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:21.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:21.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:21.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:22.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:22.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:22.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:22.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:23.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:23.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:23.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:23.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:24.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:24.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:24.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:24.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:25.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:25.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:25.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:25.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:26.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:26.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:26.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:26.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:27.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:27.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:27.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:27.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:28.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:28.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:28.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:28.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:29.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:29.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:29.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:29.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:30.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:30.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:30.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:30.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:31.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:31.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:31.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:31.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:32.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:32.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:32.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:32.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:33.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:33.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:33.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:33.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:34.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:34.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:34.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:34.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:35.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:35.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:35.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:35.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:36.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:36.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:36.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:36.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:37.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:37.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:37.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:37.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:38.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:38.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:38.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:38.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:39.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:39.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:39.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:39.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:40.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:40.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:40.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:40.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:41.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:41.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:41.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:41.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:42.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:42.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:42.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:42.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:43.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:43.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:43.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:43.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:44.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:44.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:44.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:44.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:45.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:45.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:45.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:45.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:46.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:46.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:46.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:46.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:47.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:47.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:47.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:47.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:48.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:48.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:48.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:48.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:49.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:49.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:49.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:49.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:50.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:50.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:50.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:50.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:51.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:51.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:51.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:51.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:52.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:52.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:52.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:52.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:53.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:53.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:53.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:53.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:54.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:54.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:54.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:54.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:55.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:55.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:55.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:55.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:56.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:56.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:56.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:56.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:57.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:57.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:57.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:57.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:58.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:58.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:58.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:58.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:59.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:43:59.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:43:59.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:43:59.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:00.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:00.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:00.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:00.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:01.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:01.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:01.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:01.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:02.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:02.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:02.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:02.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:03.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:03.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:03.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:03.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:04.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:04.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:04.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:04.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:05.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:05.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:05.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:05.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:06.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:06.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:06.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:06.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:07.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:07.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:07.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:07.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:08.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:08.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:08.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:08.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:09.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:09.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:09.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:09.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:10.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:10.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:10.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:10.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:11.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:11.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:11.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:11.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:12.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:12.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:12.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:12.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:13.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:13.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:13.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:13.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:14.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:14.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:14.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:14.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:15.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:15.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:15.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:15.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:16.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:16.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:16.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:16.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:17.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:17.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:17.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:17.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:18.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:18.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:18.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:18.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:19.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:19.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:19.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:19.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:20.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:20.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:20.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:20.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:21.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:21.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:21.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:21.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:22.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:22.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:22.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:22.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:23.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:23.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:23.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:23.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:24.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:24.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:24.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:24.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:25.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:25.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:25.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:25.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:26.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:26.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:26.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:26.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:27.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:27.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:27.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:27.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:28.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:28.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:28.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:28.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:29.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:29.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:29.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:29.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:30.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:30.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:30.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:30.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:31.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:31.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:31.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:31.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:32.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:32.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:32.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:32.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:33.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:33.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:33.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:33.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:34.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:34.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:34.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:34.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:35.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:35.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:35.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:35.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:36.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:36.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:36.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:36.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:37.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:37.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:37.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:37.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:38.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:38.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:38.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:38.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:39.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:39.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:39.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:39.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:40.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:40.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:40.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:40.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:41.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:41.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:41.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:41.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:42.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:42.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:42.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:42.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:43.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:43.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:43.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:43.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:44.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:44.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:44.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:44.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:45.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:45.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:45.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:45.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:46.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:46.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:46.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:46.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:47.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:47.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:47.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:47.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:48.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:48.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:48.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:48.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:49.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:49.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:49.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:49.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:50.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:50.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:50.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:50.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:51.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:51.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:51.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:51.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:52.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:52.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:52.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:52.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:53.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:53.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:53.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:53.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:54.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:54.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:54.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:54.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:55.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:55.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:55.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:55.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:56.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:56.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:56.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:56.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:57.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:57.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:57.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:57.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:58.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:58.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:58.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:58.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:59.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:44:59.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:44:59.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:44:59.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:00.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:00.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:00.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:00.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:01.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:01.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:01.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:01.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:02.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:02.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:02.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:02.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:03.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:03.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:03.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:03.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:04.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:04.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:04.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:04.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:05.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:05.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:05.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:05.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:06.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:06.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:06.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:06.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:07.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:07.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:07.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:07.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:08.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:08.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:08.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:08.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:09.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:09.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:09.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:09.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:10.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:10.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:10.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:10.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:11.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:11.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:11.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:11.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:12.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:12.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:12.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:12.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:13.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:13.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:13.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:13.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:14.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:14.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:14.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:14.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:15.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:15.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:15.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:15.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:16.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:16.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:16.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:16.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:17.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:17.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:17.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:17.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:18.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:18.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:18.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:18.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:19.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:19.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:19.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:19.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:20.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:20.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:20.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:20.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:21.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:21.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:21.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:21.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:22.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:22.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:22.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:22.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:23.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:23.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:23.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:23.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:24.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:24.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:24.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:24.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:25.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:25.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:25.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:25.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:26.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:26.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:26.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:26.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:27.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:27.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:27.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:27.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:28.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:28.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:28.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:28.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:29.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:29.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:29.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:29.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:30.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:30.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:30.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:30.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:31.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:31.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:31.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:31.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:32.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:32.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:32.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:32.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:33.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:33.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:33.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:33.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:34.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:34.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:34.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:34.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:35.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:35.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:35.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:35.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:36.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:36.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:36.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:36.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:37.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:37.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:38.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:37.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:38.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:38.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:39.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:38.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:39.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:39.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:40.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:39.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:40.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:40.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:41.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:40.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:41.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:41.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:41.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:41.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:42.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:42.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:42.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:42.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:43.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:43.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:43.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:43.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:44.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:44.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:44.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:44.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:45.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:45.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:46.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:45.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:46.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:46.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:47.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:46.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:47.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:47.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:48.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:47.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:48.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:48.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:49.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:48.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:49.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:49.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:50.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:50.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:50.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:50.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:51.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:51.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:51.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:51.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:52.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:51.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:52.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:52.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:53.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:52.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:53.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:53.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:54.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:53.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:54.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:54.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:54.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:54.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:55.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:55.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:55.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:55.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:56.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:56.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:56.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:56.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:57.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:57.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:57.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:57.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:58.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:58.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:58.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:58.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:59.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:45:59.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:45:59.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:45:59.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:00.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:00.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:00.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:00.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:01.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:01.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:01.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:01.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:02.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:02.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:02.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:02.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:03.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:03.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:04.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:03.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:04.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:04.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:05.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:04.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:05.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:05.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:06.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:05.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:06.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:06.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:07.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:07.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:07.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:07.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:08.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:07.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:08.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:08.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:09.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:09.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:09.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:09.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:10.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:10.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:10.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:10.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:11.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:11.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:11.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:11.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:12.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:12.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:12.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:12.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:13.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:13.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:13.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:13.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:14.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:14.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:14.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:14.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:15.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:15.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:15.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:15.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:16.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:16.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:16.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:16.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:17.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:17.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:17.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:17.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:18.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:18.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:18.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:18.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:19.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:19.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:19.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:19.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:20.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:20.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:20.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:20.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:21.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:21.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:21.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:21.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:22.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:22.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:22.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:22.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:23.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:23.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:23.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:23.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:24.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:24.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:24.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:24.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:25.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:25.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:25.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:25.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:26.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:26.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:26.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:26.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:27.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:27.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:27.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:27.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:28.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:28.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:28.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:28.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:29.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:29.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:29.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:29.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:30.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:30.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:30.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:30.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:31.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:31.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:31.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:31.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:32.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:32.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:32.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:32.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:33.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:33.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:33.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:33.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:34.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:34.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:34.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:34.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:35.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:35.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:35.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:35.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:36.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:36.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:36.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:36.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:37.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:37.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:37.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:37.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:38.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:38.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:38.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:38.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:39.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:39.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:39.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:39.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:40.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:40.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:40.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:40.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:41.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:41.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:41.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:41.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 5 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-22T23:46:42.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:42.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:42.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:42.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:43.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:43.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:43.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:43.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:44.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:44.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:44.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:44.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:45.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:45.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:45.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:45.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:46.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:46.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:46.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:46.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:47.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:47.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:47.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:47.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:48.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:48.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:48.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:48.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:49.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:49.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:49.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:49.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:50.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:50.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:50.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:50.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:51.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:51.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:51.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:51.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:52.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:52.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:52.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:52.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:53.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:53.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:53.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:53.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:54.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:54.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:54.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:54.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:55.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:55.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:55.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:55.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:56.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:56.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:56.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:56.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:57.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:57.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:57.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:57.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:58.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:57.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:58.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:58.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:59.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:58.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:46:59.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:46:59.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:00.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:46:59.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:00.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:00.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:01.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:00.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:01.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:01.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:01.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:01.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:02.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:02.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:03.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:02.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:03.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:03.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:03.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:03.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:04.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:04.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:05.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:04.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:05.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:05.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:06.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:05.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:06.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:06.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:07.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:07.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:07.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:07.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:08.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:08.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:08.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:08.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:09.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:09.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:09.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:09.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:10.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:10.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:10.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:10.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:11.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:11.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:11.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:11.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:12.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:12.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:12.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:12.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:13.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:13.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:13.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:13.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:14.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:14.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:14.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:14.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:15.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:15.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:15.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:15.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:16.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:16.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:16.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:16.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:17.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:17.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:17.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:17.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:18.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:17.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:18.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:18.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:19.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:19.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:19.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:19.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:20.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:20.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:20.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:20.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:21.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:20.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:21.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:21.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:22.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:21.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:22.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:22.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:23.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:22.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:23.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:23.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:24.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:24.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:24.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:24.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:25.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:24.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:25.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:25.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:26.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:26.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:26.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:26.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:27.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:27.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:27.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:27.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:28.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:28.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:28.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:28.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:29.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:28.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:29.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:29.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:30.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:29.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:30.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:30.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:30.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:30.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:31.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:31.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:32.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:31.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:32.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:32.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:33.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:32.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:33.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:33.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:34.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:33.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:34.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:34.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:35.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:34.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:35.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:35.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:36.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:36.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:36.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:36.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:37.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:37.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:37.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:37.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:38.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:37.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:38.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:38.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:39.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:38.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:39.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:39.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:40.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:39.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:40.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:40.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:41.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:40.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:41.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:41.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:42.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:41.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:42.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:42.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:43.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:42.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:43.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:43.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:44.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:44.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:44.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:44.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:45.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:45.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:45.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:45.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:46.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:46.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:46.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:46.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:47.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:47.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:47.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:47.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:48.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:48.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:48.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:48.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:49.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:49.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:49.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:49.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:50.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:49.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:50.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:50.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:51.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:51.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:51.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:51.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:52.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:52.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:52.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:52.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:53.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:53.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:53.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:53.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:54.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:54.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:54.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:54.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:55.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:55.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:55.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:55.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:56.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:56.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:56.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:56.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:57.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:57.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:57.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:57.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:58.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:57.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:58.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:58.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:59.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:58.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:59.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:47:59.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:47:59.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:47:59.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:00.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:00.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:00.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:00.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:01.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:01.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:01.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:01.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:02.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:02.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:03.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:02.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:03.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:03.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:04.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:03.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:04.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:04.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:05.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:04.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:05.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:05.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:05.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:05.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:06.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:06.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:06.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:06.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:07.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:07.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:08.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:07.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:09.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:08.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:09.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:08.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:10.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:09.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:10.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:09.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:10.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:10.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:11.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:10.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:12.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:11.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:12.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:11.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:13.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:12.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:13.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:12.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:14.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:13.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:14.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:14.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:15.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:15.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:15.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:15.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:16.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:15.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:16.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:16.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:17.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:16.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:17.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:17.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:18.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:17.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:18.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:18.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:18.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:18.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:19.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:19.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:19.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:19.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:20.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:19.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:20.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:20.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:21.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:20.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:22.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:21.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:22.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:21.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:23.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:22.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:23.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:23.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:24.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:23.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:24.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:24.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:25.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:24.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:25.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:24.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:26.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:25.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:26.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:25.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:26.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:26.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:27.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:26.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:28.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:27.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:28.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:27.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:28.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:28.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:29.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:28.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:29.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:29.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:29.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:29.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:30.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:30.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:31.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:30.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:31.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:31.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:31.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:31.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:32.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:32.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:32.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:32.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:33.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:33.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:33.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:33.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:34.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:34.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:34.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:34.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:35.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:35.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:35.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:35.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:36.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:36.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:37.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:36.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:37.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:37.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:38.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:37.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:38.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:38.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:39.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:38.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:39.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:39.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:40.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:39.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:40.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:40.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:41.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:41.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:41.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:41.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:42.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:41.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:42.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:42.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:43.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:42.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:43.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:43.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:43.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:43.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:44.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:44.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:44.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:44.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:45.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:45.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:45.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:45.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:46.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:46.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:47.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:46.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:47.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:47.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:48.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:47.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:48.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:48.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:49.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:48.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:49.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:49.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:50.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:49.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:50.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:50.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:50.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:50.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:51.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:51.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:51.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:51.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:52.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:52.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:52.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:52.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:53.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:53.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:53.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:53.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:54.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:54.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:54.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:54.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:55.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:55.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:55.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:55.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:56.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:56.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:57.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:56.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:57.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:57.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:58.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:57.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:58.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:58.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:59.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:48:58.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:48:59.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:48:59.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:00.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:00.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:00.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:00.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:01.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:01.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:01.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:01.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:02.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:02.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:02.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:02.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:03.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:02.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:03.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:03.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:04.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:03.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:04.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:04.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:05.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:04.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:05.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:05.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:06.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:06.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:06.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:06.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:07.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:07.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:07.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:07.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:08.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:08.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:08.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:08.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:09.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:09.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:09.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:09.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:10.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:10.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:10.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:10.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:11.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:11.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:11.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:11.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:12.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:12.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:12.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:12.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:13.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:13.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:13.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:13.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:14.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:14.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:14.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:14.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:15.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:15.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:15.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:15.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:16.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:16.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:16.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:16.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:17.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:17.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:17.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:17.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:18.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:18.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:18.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:18.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:19.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:19.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:19.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:19.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:20.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:20.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:20.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:20.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:21.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:21.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:21.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:21.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:22.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:22.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:22.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:22.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:23.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:23.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:23.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:23.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:24.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:24.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:24.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:24.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:25.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:25.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:25.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:25.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:26.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:26.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:26.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:26.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:27.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:27.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:27.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:27.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:28.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:28.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:28.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:28.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:29.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:29.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:29.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:29.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:30.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:30.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:30.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:30.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:31.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:31.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:31.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:31.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:32.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:32.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:32.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:32.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:33.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:33.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:33.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:33.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:34.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:34.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:34.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:34.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:35.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:35.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:35.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:35.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:36.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:36.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:36.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:36.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:37.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:37.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:37.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:37.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:38.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:38.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:38.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:38.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:39.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:39.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:39.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:39.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:40.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:40.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:40.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:40.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:41.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:41.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:41.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:41.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:42.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:42.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:42.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:42.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:43.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:43.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:43.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:43.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:44.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:44.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:44.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:44.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:45.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:45.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:45.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:45.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:46.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:46.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:46.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:46.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:47.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:47.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:47.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:47.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:48.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:48.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:48.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:48.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:49.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:49.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:49.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:49.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:50.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:50.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:50.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:50.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:51.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:51.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:51.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:51.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:52.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:52.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:52.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:52.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:53.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:53.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:53.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:53.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:54.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:54.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:54.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:54.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:55.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:55.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:55.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:55.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:56.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:56.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:56.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:56.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:57.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:57.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:57.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:57.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:58.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:58.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:58.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:58.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:59.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:49:59.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:49:59.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:49:59.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:00.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:00.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:00.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:00.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:01.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:01.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:01.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:01.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:02.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:02.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:02.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:02.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:03.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:03.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:03.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:03.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:04.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:04.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:04.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:04.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:05.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:05.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:05.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:05.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:06.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:06.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:06.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:06.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:07.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:07.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:07.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:07.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:08.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:08.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:08.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:08.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:09.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:09.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:09.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:09.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:10.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:10.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:10.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:10.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:11.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:11.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:11.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:11.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:12.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:12.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:12.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:12.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:13.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:13.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:13.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:13.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:14.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:14.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:14.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:14.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:15.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:15.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:15.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:15.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:16.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:16.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:16.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:16.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:17.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:17.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:17.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:17.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:18.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:18.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:18.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:18.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:19.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:19.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:19.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:19.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:20.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:20.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:20.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:20.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:21.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:21.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:21.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:21.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:22.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:22.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:22.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:22.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:23.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:23.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:23.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:23.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:24.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:24.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:24.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:24.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:25.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:25.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:25.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:25.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:26.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:26.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:26.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:26.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:27.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:27.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:27.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:27.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:28.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:28.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:28.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:28.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:29.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:29.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:29.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:29.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:30.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:30.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:30.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:30.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:31.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:31.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:31.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:31.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:32.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:32.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:33.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:32.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:33.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:33.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:34.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:33.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:34.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:34.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:35.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:34.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:35.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:35.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:36.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:36.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:36.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:36.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:37.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:36.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:37.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:37.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:38.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:37.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:38.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:38.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:39.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:39.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:39.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:39.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:40.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:40.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:40.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:40.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:41.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:41.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:41.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:41.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:42.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:42.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:42.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:42.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:43.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:43.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:43.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:43.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:44.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:44.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:44.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:44.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:45.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:45.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:45.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:45.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:46.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:46.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:46.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:46.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:47.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:47.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:47.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:47.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:48.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:48.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:48.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:48.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:49.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:49.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:49.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:49.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:50.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:50.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:50.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:50.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:51.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:51.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:51.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:51.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:52.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:52.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:52.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:52.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:53.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:53.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:53.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:53.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:54.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:54.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:54.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:54.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:55.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:55.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:55.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:55.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:56.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:56.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:56.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:56.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:57.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:57.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:57.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:57.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:58.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:58.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:58.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:58.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:59.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:58.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:50:59.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:50:59.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:00.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:50:59.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:00.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:00.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:01.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:01.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:01.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:01.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:02.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:02.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:02.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:02.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:03.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:03.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:03.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:03.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:04.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:03.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:04.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:04.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:05.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:04.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:05.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:05.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:06.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:05.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:06.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:06.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:07.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:06.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:07.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:07.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:08.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:07.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:08.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:08.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:09.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:09.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:09.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:09.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:10.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:09.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:10.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:10.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:11.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:10.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:11.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:11.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:12.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:11.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:12.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:12.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:13.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:12.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:13.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:13.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:14.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:13.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:14.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:14.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:15.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:15.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:15.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:15.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:16.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:15.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:16.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:16.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:17.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:16.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:17.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:17.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:18.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:17.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:18.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:18.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:18.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:18.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:19.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:19.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:19.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:19.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:20.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:20.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:20.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:20.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:21.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:21.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:21.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:21.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:22.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:22.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:22.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:22.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:23.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:23.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:23.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:23.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:24.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:24.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:24.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:24.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:25.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:25.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:26.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:25.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:26.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:26.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:26.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:26.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:27.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:27.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:28.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:27.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:28.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:28.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:29.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:29.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:29.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:29.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:30.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:30.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:30.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:30.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:31.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:30.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:31.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:31.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:32.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:31.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:32.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:32.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:33.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:32.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:33.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:33.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:34.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:33.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:34.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:34.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:35.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:35.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:35.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:35.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:36.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:36.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:36.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:36.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:37.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:37.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:37.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:37.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:38.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:38.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:38.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:38.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:39.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:39.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:39.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:39.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:40.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:40.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:40.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:40.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:41.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:41.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:41.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:41.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:42.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:42.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:42.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:42.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:43.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:43.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:43.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:43.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:44.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:44.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:44.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:44.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:45.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:45.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:45.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:45.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:46.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:46.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:46.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:46.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:47.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:47.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:47.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:47.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:48.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:48.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:48.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:48.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:49.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:49.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:49.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:49.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:50.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:50.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:50.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:50.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:51.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:51.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:51.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:51.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:52.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:52.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:52.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:52.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:53.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:53.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:53.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:53.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:54.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:54.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:54.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:54.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:55.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:55.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:55.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:55.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:56.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:56.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:56.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:56.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:57.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:57.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:57.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:57.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:58.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:58.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:58.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:58.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:59.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:51:59.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:51:59.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:51:59.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:00.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:00.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:00.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:00.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:01.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:01.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:01.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:01.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:02.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:02.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:02.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:02.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:03.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:03.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:03.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:03.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:04.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:04.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:04.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:04.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:05.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:05.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:05.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:05.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:06.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:06.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:06.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:06.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:07.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:07.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:07.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:07.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:08.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:08.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:08.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:08.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:09.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:09.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:09.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:09.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:10.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:10.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:10.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:10.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:11.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:11.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:11.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:11.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:12.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:12.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:12.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:12.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:13.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:13.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:13.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:13.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:14.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:14.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:14.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:14.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:15.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:15.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:15.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:15.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:16.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:16.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:16.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:16.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:17.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:17.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:17.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:17.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:18.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:18.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:18.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:18.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:19.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:19.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:19.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:19.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:20.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:20.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:20.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:20.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:21.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:21.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:21.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:21.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:22.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:22.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:22.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:22.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:23.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:23.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:23.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:23.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:24.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:24.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:24.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:24.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:25.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:25.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:25.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:25.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:26.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:26.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:26.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:26.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:27.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:27.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:27.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:27.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:28.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:28.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:28.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:28.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:29.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:29.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:29.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:29.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:30.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:30.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:31.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:30.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:31.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:31.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:32.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:31.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:32.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:32.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:33.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:32.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:33.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:33.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:33.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:33.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:34.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:34.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:34.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:34.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:35.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:35.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:35.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:35.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:36.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:36.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:36.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:36.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:37.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:37.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:37.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:37.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:38.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:38.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:38.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:38.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:39.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:39.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:39.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:39.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:40.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:40.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:40.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:40.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:41.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:41.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:41.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:41.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:42.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:42.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:42.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:42.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:43.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:43.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:43.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:43.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:44.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:44.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:44.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:44.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:45.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:45.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:45.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:45.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:46.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:46.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:46.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:46.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:47.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:47.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:47.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:47.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:48.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:48.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:48.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:48.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:49.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:49.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:49.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:49.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:50.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:50.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:50.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:50.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:51.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:51.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:51.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:51.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:52.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:52.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:52.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:52.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:53.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:53.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:53.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:53.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:54.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:54.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:54.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:54.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:55.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:55.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:55.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:55.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:56.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:56.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:56.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:56.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:57.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:57.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:57.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:57.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:58.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:58.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:58.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:58.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:59.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:52:59.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:52:59.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:52:59.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:00.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:00.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:00.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:00.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:01.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:01.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:01.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:01.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:02.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:02.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:02.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:02.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:03.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:03.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:03.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:03.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:04.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:04.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:04.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:04.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:05.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:05.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:05.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:05.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:06.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:06.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:06.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:06.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:07.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:07.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:07.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:07.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:08.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:08.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:08.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:08.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:09.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:09.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:09.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:09.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:10.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:09.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:10.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:10.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:11.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:10.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:11.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:11.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:12.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:11.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:12.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:12.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:13.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:12.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:13.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:13.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:14.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:13.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:14.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:14.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:15.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:14.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:15.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:15.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:16.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:15.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:16.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:16.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:17.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:17.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:17.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:17.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:18.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:18.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:18.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:18.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:19.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:18.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:19.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:19.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:20.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:20.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:20.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:20.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:21.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:20.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:21.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:21.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:22.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:21.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:22.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:22.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:23.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:22.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:23.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:23.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:24.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:23.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:24.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:24.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:25.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:24.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:25.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:25.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:25.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:25.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:26.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:26.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:26.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:26.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:27.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:27.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:28.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:27.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:28.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:28.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:29.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:28.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:29.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:29.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:30.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:29.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:30.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:30.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:31.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:30.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:31.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:31.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:32.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:31.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:32.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:32.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:33.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:33.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:33.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:33.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:34.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:34.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:34.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:34.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:35.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:35.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:35.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:35.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:36.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:36.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:36.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:36.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:37.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:37.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:37.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:37.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:38.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:38.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:38.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:38.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:39.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:39.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:39.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:39.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:40.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:40.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:40.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:40.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:41.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:41.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:41.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:41.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:42.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:42.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:42.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:42.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:43.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:43.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:43.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:43.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:44.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:44.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:44.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:44.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:45.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:45.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:45.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:45.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:46.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:46.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:46.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:46.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:47.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:47.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:47.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:47.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:48.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:48.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:48.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:48.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:49.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:49.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:49.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:49.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:50.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:50.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:50.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:50.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:51.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:51.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:51.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:51.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:52.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:52.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:52.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:52.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:53.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:53.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:53.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:53.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:54.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:54.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:54.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:54.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:55.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:55.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:55.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:55.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:56.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:56.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:56.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:56.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:57.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:57.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:57.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:57.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:58.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:58.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:58.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:58.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:59.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:58.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:53:59.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:53:59.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:00.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:53:59.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:00.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:00.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:01.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:00.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:01.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:01.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:02.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:01.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:02.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:02.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:03.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:02.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:03.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:03.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:04.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:03.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:04.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:04.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:05.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:04.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:05.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:05.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:05.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:05.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:06.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:06.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:07.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:06.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:07.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:07.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:08.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:07.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:08.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:08.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:09.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:08.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:09.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:09.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:09.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:09.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:10.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:10.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:11.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:10.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:11.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:11.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:12.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:11.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:12.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:12.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:13.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:12.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:13.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:13.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:13.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:13.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:14.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:14.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:15.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:14.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:15.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:15.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:16.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:15.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:16.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:16.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:17.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:16.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:17.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:17.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:18.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:17.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:18.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:18.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:19.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:19.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:19.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:19.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:20.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:20.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:20.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:20.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:21.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:21.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:21.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:21.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:22.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:21.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:22.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:22.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:23.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:23.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:23.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:23.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:24.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:24.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:24.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:24.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:25.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:24.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:25.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:25.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:26.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:25.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:26.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:26.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:27.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:26.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:27.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:27.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:28.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:28.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:28.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:28.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:29.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:28.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:29.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:29.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:30.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:30.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:30.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:30.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:31.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:31.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:31.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:31.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:32.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:32.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:32.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:32.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:33.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:32.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:33.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:33.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:34.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:33.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:34.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:34.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:35.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:35.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:35.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:35.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:36.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:36.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:36.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:36.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:37.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:37.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:37.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:37.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:38.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:38.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:38.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:38.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:39.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:39.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:39.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:39.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:40.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:40.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:40.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:40.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:41.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:41.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:41.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:41.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:42.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:42.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:42.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:42.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:43.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:43.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:43.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:43.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:44.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:44.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:44.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:44.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:45.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:45.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:45.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:45.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:46.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:45.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:46.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:46.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:47.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:46.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:47.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:47.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:48.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:47.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:48.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:48.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:49.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:48.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:49.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:49.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:50.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:49.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:50.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:50.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:51.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:50.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:51.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:51.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:52.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:51.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:52.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:52.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:53.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:53.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:53.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:53.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:54.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:53.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:54.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:54.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:55.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:54.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:55.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:55.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:56.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:55.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:56.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:56.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:57.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:56.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:57.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:57.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:58.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:57.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:58.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:58.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:59.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:58.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:54:59.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:54:59.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:00.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:54:59.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:00.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:00.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:01.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:01.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:01.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:01.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:02.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:02.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:02.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:02.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:03.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:03.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:03.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:03.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:04.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:04.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:04.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:04.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:05.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:05.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:05.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:05.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:06.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:06.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:06.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:06.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:07.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:07.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:07.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:07.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:08.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:08.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:08.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:08.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:09.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:09.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:09.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:09.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:10.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:10.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:10.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:10.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:11.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:11.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:11.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:11.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:12.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:12.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:12.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:12.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:13.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:13.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:13.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:13.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:14.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:14.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:14.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:14.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:15.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:15.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:15.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:15.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:16.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:16.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:16.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:16.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:17.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:17.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:17.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:17.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:18.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:18.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:18.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:18.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:19.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:19.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:19.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:19.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:20.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:20.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:20.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:20.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:21.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:21.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:21.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:21.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:22.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:22.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:22.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:22.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:23.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:23.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:23.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:23.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:24.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:24.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:24.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:24.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:25.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:25.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:25.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:25.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:26.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:26.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:26.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:26.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:27.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:27.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:27.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:27.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:28.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:28.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:28.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:28.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:29.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:29.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:29.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:29.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:30.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:30.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:30.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:30.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:31.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:31.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:31.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:31.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:32.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:32.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:32.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:32.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:33.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:33.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:33.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:33.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:34.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:34.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:34.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:34.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:35.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:35.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:35.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:35.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:36.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:36.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:36.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:36.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:37.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:37.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:37.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:37.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:38.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:38.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:38.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:38.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:39.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:39.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:39.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:39.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:40.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:40.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:40.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:40.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:41.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:41.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:41.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:41.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:42.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:42.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:42.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:42.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:43.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:43.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:43.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:43.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:44.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:44.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:44.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:44.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:45.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:45.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:45.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:45.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:46.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:46.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:46.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:46.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:47.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:47.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:47.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:47.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:48.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:48.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:48.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:48.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:49.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:49.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:49.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:49.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:50.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:50.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:50.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:50.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:51.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:51.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:51.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:51.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:52.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:52.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:52.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:52.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:53.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:53.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:53.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:53.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:54.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:54.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:54.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:54.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:55.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:55.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:55.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:55.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:56.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:56.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:56.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:56.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:57.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:57.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:57.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:57.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:58.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:58.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:58.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:58.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:59.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:55:59.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:55:59.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:55:59.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:00.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:00.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:00.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:00.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:01.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:01.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:01.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:01.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:02.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:02.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:02.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:02.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:03.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:03.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:03.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:03.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:04.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:04.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:04.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:04.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:05.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:05.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:05.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:05.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:06.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:06.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:06.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:06.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:07.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:07.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:07.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:07.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:08.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:08.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:08.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:08.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:09.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:09.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:09.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:09.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:10.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:10.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:10.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:10.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:11.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:11.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:11.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:11.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:12.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:12.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:12.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:12.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:13.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:13.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:13.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:13.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:14.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:14.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:14.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:14.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:15.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:15.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:15.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:15.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:16.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:16.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:16.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:16.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:17.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:17.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:17.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:17.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:18.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:18.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:18.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:18.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:19.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:19.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:19.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:19.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:20.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:20.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:20.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:20.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:21.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:21.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:21.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:21.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:22.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:22.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:22.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:22.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:23.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:23.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:23.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:23.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:24.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:24.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:24.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:24.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:25.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:25.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:25.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:25.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:26.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:26.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:26.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:26.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:27.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:27.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:27.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:27.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:28.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:28.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:28.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:28.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:29.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:29.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:29.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:29.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:30.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:30.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:30.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:30.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:31.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:31.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:31.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:31.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:32.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:32.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:32.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:32.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:33.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:33.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:33.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:33.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:34.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:34.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:34.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:34.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:35.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:35.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:35.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:35.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:36.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:36.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:36.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:36.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:37.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:37.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:37.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:37.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:38.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:38.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:38.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:38.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:39.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:39.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:39.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:39.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:40.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:40.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:40.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:40.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:41.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:41.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:41.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:41.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:42.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:42.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:42.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:42.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:43.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:43.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:43.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:43.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:44.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:44.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:44.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:44.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:45.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:45.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:45.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:45.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:46.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:46.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:46.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:46.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:47.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:47.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:47.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:47.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:48.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:48.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:48.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:48.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:49.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:49.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:49.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:49.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:50.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:50.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:50.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:50.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:51.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:51.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:51.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:51.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:52.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:52.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:52.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:52.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:53.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:53.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:53.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:53.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:54.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:54.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:54.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:54.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:55.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:55.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:55.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:55.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:56.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:56.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:56.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:56.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:57.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:57.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:57.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:57.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:58.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:58.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:58.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:58.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:59.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:56:59.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:56:59.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:56:59.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:00.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:00.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:00.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:00.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:01.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:01.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:01.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:01.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:02.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:02.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:02.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:02.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:03.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:03.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:03.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:03.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:04.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:04.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:04.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:04.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:05.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:05.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:05.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:05.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:06.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:06.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:06.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:06.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:07.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:07.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:07.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:07.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:08.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:08.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:08.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:08.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:09.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:09.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:09.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:09.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:10.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:10.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:10.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:10.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:11.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:11.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:11.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:11.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:12.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:12.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:12.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:12.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:13.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:13.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:13.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:13.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:14.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:14.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:14.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:14.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:15.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:15.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:15.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:15.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:16.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:16.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:16.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:16.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:17.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:17.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:17.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:17.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:18.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:18.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:18.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:18.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:19.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:19.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:19.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:19.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:20.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:20.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:20.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:20.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:21.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:21.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:21.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:21.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:22.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:22.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:22.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:22.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:23.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:23.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:23.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:23.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:24.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:24.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:24.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:24.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:25.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:25.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:25.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:25.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:26.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:26.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:26.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:26.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:27.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:27.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:27.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:27.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:28.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:28.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:28.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:28.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:29.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:29.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:29.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:29.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:30.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:30.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:30.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:30.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:31.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:31.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:31.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:31.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:32.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:32.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:32.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:32.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:33.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:33.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:33.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:33.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:34.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:34.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:34.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:34.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:35.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:35.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:35.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:35.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:36.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:36.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:36.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:36.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:37.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:37.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:37.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:37.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:38.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:38.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:38.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:38.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:39.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:39.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:39.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:39.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:40.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:40.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:40.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:40.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:41.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:41.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:41.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:41.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:42.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:42.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:42.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:42.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:43.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:43.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:43.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:43.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:44.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:44.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:44.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:44.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:45.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:44.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:45.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:45.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:46.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:46.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:46.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:46.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:47.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:46.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:47.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:47.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:48.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:47.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:48.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:48.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:49.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:48.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:49.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:49.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:50.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:49.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:50.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:50.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:51.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:51.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:51.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:51.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:52.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:52.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:52.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:52.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:53.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:52.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:53.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:53.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:54.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:53.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:54.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:54.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:54.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:54.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:55.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:55.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:55.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:55.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:56.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:56.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:56.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:56.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:57.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:57.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:58.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:57.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:58.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:58.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:59.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:58.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:57:59.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:57:59.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:00.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:57:59.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:00.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:00.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:01.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:00.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:01.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:01.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:02.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:01.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:02.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:02.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:03.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:02.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:03.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:03.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:04.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:03.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:04.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:04.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:05.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:04.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:05.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:05.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:06.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:05.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:06.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:06.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:07.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:06.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:07.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:07.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:08.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:07.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:08.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:08.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:09.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:08.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:09.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:09.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:10.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:09.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:10.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:10.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:11.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:10.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:11.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:11.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:12.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:11.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:12.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:12.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:13.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:13.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:13.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:13.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:14.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:13.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:14.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:14.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:15.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:14.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:15.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:15.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:15.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:15.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:16.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:16.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:17.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:16.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:17.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:17.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:18.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:17.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:18.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:18.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:19.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:18.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:19.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:19.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:20.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:19.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:20.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:20.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:20.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:20.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:21.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:21.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:21.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:21.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:22.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:22.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:22.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:22.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:23.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:23.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:23.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:23.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:24.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:24.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:24.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:24.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:25.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:25.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:25.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:25.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:26.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:26.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:26.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:26.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:27.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:27.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:27.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:27.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:28.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:28.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:29.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:28.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:29.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:29.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:30.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:29.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:30.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:30.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:31.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:30.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:31.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:31.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:32.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:31.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:32.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:32.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:33.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:32.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:33.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:33.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:33.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:33.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:34.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:34.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:35.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:34.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:35.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:35.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:35.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:35.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:36.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:36.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:36.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:36.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:37.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:37.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:37.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:37.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:38.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:38.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:38.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:38.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:39.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:39.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:39.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:39.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:40.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:40.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:40.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:40.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:41.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:41.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:41.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:41.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:42.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:42.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:42.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:42.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:43.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:43.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:43.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:43.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:44.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:44.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:44.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:44.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:45.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:45.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:45.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:45.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:46.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:46.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:46.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:46.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:47.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:47.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:47.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:47.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:48.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:48.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:48.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:48.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:49.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:49.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:49.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:49.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:50.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:50.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:50.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:50.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:51.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:51.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:51.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:51.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:52.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:52.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:52.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:52.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:53.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:53.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:53.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:53.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:54.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:54.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:55.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:54.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:55.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:55.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:55.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:55.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:56.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:56.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:56.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:56.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:57.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:57.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:57.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:57.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:58.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:58.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:58.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:58.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:59.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:58:59.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:58:59.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:58:59.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:00.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:00.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:00.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:00.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:01.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:01.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:01.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:01.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:02.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:02.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:02.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:02.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:03.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:03.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:03.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:03.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:04.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:04.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:04.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:04.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:05.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:05.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:05.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:05.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:06.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:06.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:06.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:06.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:07.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:07.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:07.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:07.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:08.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:08.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:08.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:08.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:09.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:09.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:10.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:09.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:10.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:10.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:10.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:10.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:11.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:11.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:12.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:11.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:12.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:12.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:12.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:12.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:13.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:13.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:13.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:13.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:14.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:14.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:14.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:14.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:15.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:15.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:15.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:15.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:16.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:16.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:16.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:16.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:17.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:17.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:17.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:17.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:18.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:18.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:18.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:18.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:19.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:19.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:19.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:19.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:20.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:20.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:20.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:20.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:21.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:21.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:21.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:21.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:22.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:22.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:22.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:22.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:23.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:23.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:23.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:23.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:24.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:24.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:25.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:24.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:25.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:25.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:26.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:25.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:26.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:26.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:26.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:26.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:27.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:27.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:28.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:27.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:28.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:28.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:28.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:28.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:29.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:29.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:29.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:29.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:30.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:30.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:30.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:30.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:31.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:31.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:31.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:31.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:32.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:32.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:32.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:32.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:33.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:33.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:33.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:33.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:34.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:34.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:34.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:34.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:35.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:35.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:35.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:35.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:36.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:36.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:36.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:36.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:37.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:37.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:37.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:37.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:38.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:38.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:38.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:38.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:39.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:39.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:39.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:39.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:40.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:40.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:40.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:40.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:41.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:41.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:41.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:41.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:42.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:42.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:42.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:42.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:43.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:43.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:43.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:43.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:44.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:44.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:44.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:44.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:45.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:45.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:45.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:45.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:46.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:46.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:46.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:46.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:47.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:47.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:47.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:47.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:48.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:48.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:48.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:48.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:49.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:49.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:49.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:49.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:50.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:50.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:50.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:50.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:51.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:51.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:51.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:51.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:52.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:52.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:52.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:52.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:53.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:53.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:53.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:53.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:54.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:54.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:54.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:54.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:55.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:55.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:55.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:55.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:56.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:56.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:56.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:56.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:57.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:57.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:57.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:57.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:58.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:58.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:58.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:58.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:59.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-22T23:59:59.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-22T23:59:59.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-22T23:59:59.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:00.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:00.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:00.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:00.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:01.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:01.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:01.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:01.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:02.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:02.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:02.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:02.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:03.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:03.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:03.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:03.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:04.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:04.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:04.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:04.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:05.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:05.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:05.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:05.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:06.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:06.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:06.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:06.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:07.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:07.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:07.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:07.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:08.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:08.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:08.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:08.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:09.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:09.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:09.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:09.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:10.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:10.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:10.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:10.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:11.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:11.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:11.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:11.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:12.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:12.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:12.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:12.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:13.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:13.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:13.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:13.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:14.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:14.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:14.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:14.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:15.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:15.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:15.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:15.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:16.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:16.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:16.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:16.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:17.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:17.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:17.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:17.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:18.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:18.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:18.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:18.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:19.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:19.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:19.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:19.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:20.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:20.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:20.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:20.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:21.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:21.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:21.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:21.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:22.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:22.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:22.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:22.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:23.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:23.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:23.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:23.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:24.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:24.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:24.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:24.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:25.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:25.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:25.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:25.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:26.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:26.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:26.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:26.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:27.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:27.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:27.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:27.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:28.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:28.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:28.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:28.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:29.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:29.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:29.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:29.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:30.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:30.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:30.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:30.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:31.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:31.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:31.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:31.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:32.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:32.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:32.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:32.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:33.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:33.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:33.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:33.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:34.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:34.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:34.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:34.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:35.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:35.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:35.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:35.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:36.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:36.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:36.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:36.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:37.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:37.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:37.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:37.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:38.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:38.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:38.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:38.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:39.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:39.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:39.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:39.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:40.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:40.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:40.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:40.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:41.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:41.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:41.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:41.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:42.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:42.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:42.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:42.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:43.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:43.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:43.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:43.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:44.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:44.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:44.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:44.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:45.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:45.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:45.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:45.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:46.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:46.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:46.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:46.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:47.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:47.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:47.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:47.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:48.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:48.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:48.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:48.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:49.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:49.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:49.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:49.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:50.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:50.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:50.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:50.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:51.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:51.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:51.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:51.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:52.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:52.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:52.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:52.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:53.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:53.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:53.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:53.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:54.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:54.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:54.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:54.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:55.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:55.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:55.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:55.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:56.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:56.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:56.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:56.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:57.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:57.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:57.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:57.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:58.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:58.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:58.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:58.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:59.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:00:59.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:00:59.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:00:59.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:00.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:00.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:00.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:00.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:01.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:01.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:01.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:01.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:02.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:02.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:02.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:02.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:03.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:03.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:03.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:03.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:04.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:04.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:04.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:04.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:05.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:05.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:05.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:05.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:06.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:06.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:06.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:06.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:07.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:07.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:07.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:07.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:08.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:08.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:08.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:08.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:09.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:09.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:09.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:09.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:10.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:10.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:10.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:10.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:11.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:11.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 111 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:11.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:11.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:12.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:12.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:12.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:12.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:13.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:13.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:13.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:13.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:14.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:14.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:14.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:14.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:15.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:15.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:15.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:15.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:16.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:16.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:16.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:16.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:17.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:17.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:17.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:17.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:18.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:18.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:18.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:18.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:19.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:19.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:19.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:19.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:20.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:20.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:20.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:20.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:21.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:21.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:21.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:21.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:22.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:22.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:22.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:22.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:23.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:23.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:23.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:23.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:24.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:24.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:24.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:24.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:25.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:25.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:25.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:25.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:26.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:26.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:26.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:26.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:27.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:27.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:27.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:27.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:28.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:28.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:28.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:28.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:29.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:29.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:29.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:29.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:30.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:30.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:30.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:30.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:31.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:31.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:31.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:31.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:32.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:32.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:32.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:32.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:33.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:33.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:33.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:33.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:34.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:34.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:34.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:34.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:35.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:35.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:35.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:35.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:36.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:36.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:36.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:36.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:37.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:37.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:37.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:37.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:38.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:38.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:38.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:38.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:39.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:39.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:39.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:39.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:40.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:40.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:40.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:40.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:41.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:41.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:41.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:41.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 65 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:42.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:42.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:42.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:42.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:43.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:43.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:43.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:43.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:44.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:44.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:44.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:44.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:45.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:45.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:45.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:45.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:46.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:46.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:46.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:46.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:47.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:47.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:47.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:47.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:48.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:48.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:48.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:48.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:49.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:49.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:49.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:49.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:50.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:50.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:50.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:50.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:51.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:51.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:51.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:51.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:52.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:52.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:52.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:52.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:53.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:53.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:53.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:53.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:54.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:54.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:54.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:54.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:55.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:55.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:55.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:55.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:56.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:56.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:56.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:56.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:57.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:57.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:57.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:57.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:58.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:58.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:58.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:58.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:59.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:01:59.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:01:59.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:01:59.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:00.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:00.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:00.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:00.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:01.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:01.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:01.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:01.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:02.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:02.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:02.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:02.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:03.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:03.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:03.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:03.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:04.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:04.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:04.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:04.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:05.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:05.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:05.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:05.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:06.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:06.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:06.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:06.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:07.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:07.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:07.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:07.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:08.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:08.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:08.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:08.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:09.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:09.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:09.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:09.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:10.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:10.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:10.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:10.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:11.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:11.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:12.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:11.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:12.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:12.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:12.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:12.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:13.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:13.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:13.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:13.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:14.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:14.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:14.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:14.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:15.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:15.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:15.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:15.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:16.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:16.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:16.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:16.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:17.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:17.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:17.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:17.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:18.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:18.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:19.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:18.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:19.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:19.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:20.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:19.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:20.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:20.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:21.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:20.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:21.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:21.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:22.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:21.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:22.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:22.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:23.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:22.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:23.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:23.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:24.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:23.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:24.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:24.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:25.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:24.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:25.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:25.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:26.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:25.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:26.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:26.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:27.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:26.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:27.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:27.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:28.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:27.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:28.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:28.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:29.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:28.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:29.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:29.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:30.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:29.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:30.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:30.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:31.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:30.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:31.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:31.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:32.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:31.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:32.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:32.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:33.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:32.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:33.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:33.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:34.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:33.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:34.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:34.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:34.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:34.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:35.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:35.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:35.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:35.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:36.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:36.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:36.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:36.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:37.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:37.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:37.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:37.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:38.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:38.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:38.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:38.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:39.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:39.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:39.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:39.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:40.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:40.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:40.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:40.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:41.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:41.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:41.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:41.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:42.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:42.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:43.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:42.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:43.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:43.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:44.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:43.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:44.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:44.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:44.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:44.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:45.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:45.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:45.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:45.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:46.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:46.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:46.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:46.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:47.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:47.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:47.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:47.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:48.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:48.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:48.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:48.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:49.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:49.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:49.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:49.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:50.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:50.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:50.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:50.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:51.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:51.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:51.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:51.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:52.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:52.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:52.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:52.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:53.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:53.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:53.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:53.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:54.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:54.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:54.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:54.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:55.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:55.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:55.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:55.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:56.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:56.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:56.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:56.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:57.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:57.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:57.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:57.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:58.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:58.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:58.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:58.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:02:59.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:02:59.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:00.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:02:59.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:00.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:00.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:00.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:00.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:01.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:01.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:01.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:01.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:02.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:02.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:03.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:02.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:03.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:03.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:04.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:03.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:04.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:04.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:05.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:04.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:05.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:05.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:06.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:05.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:06.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:06.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:07.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:06.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:07.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:07.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:08.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:07.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:08.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:08.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:09.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:09.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:09.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:09.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:10.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:09.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:10.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:10.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:11.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:10.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:11.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:11.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:12.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:11.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:12.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:12.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:12.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:12.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:13.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:13.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:14.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:13.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:14.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:14.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:15.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:14.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:15.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:15.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:16.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:15.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:16.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:16.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:17.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:16.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:17.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:17.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:17.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:17.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:18.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:18.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:18.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:18.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:19.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:19.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:19.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:19.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:20.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:20.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:20.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:20.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:21.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:21.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:21.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:21.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:22.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:22.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:22.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:22.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:23.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:23.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:23.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:23.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:24.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:24.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:24.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:24.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:25.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:25.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:25.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:25.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:26.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:26.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:26.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:26.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:27.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:27.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:27.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:27.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:28.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:28.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:28.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:28.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:29.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:29.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:29.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:29.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:30.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:30.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:30.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:30.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:31.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:31.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:31.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:31.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:32.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:32.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:32.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:32.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:33.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:33.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:33.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:33.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:34.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:34.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:34.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:34.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:35.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:35.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:35.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:35.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:36.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:36.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:36.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:36.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:37.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:37.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:37.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:37.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:38.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:38.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:38.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:38.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:39.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:39.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:39.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:39.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:40.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:40.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:40.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:40.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:41.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:41.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:41.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:41.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:42.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:42.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:42.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:42.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:43.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:43.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:43.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:43.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:44.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:44.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:44.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:44.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:45.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:45.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:45.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:45.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:46.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:46.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:46.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:46.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:47.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:47.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:47.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:47.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:48.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:48.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:48.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:48.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:49.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:49.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:49.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:49.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:50.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:50.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:50.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:50.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:51.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:51.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:51.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:51.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:52.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:52.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:52.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:52.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:53.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:53.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:53.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:53.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:54.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:54.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:54.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:54.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:55.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:55.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:55.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:55.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:56.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:56.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:57.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:56.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:57.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:57.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:58.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:57.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:58.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:58.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:58.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:58.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:03:59.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:03:59.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:00.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:03:59.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:00.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:00.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:01.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:00.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:01.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:01.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:02.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:01.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:02.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:02.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:03.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:02.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:03.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:03.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:04.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:03.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:04.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:04.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:05.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:04.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:05.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:05.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:06.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:05.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:06.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:06.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:07.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:06.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:07.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:07.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:07.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:07.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:08.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:08.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:09.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:08.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:09.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:09.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:10.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:09.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:10.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:10.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:11.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:10.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:11.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:11.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:12.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:12.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:12.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:12.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:13.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:12.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:13.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:13.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:14.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:13.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:14.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:14.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:15.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:15.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:15.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:15.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:16.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:15.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:16.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:16.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:17.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:16.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:17.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:17.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:18.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:17.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:18.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:18.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:19.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:18.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:19.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:19.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:19.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:19.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:20.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:20.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:20.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:20.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:21.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:21.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:21.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:21.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:22.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:22.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:23.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:22.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:23.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:23.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:23.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:23.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:24.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:24.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:24.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:24.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:25.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:25.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:25.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:25.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:26.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:26.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:27.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:26.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:27.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:27.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:28.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:27.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:28.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:28.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:29.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:28.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:29.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:29.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:30.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:29.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:30.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:30.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:31.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:30.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:31.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:31.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:31.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:31.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:32.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:32.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:33.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:32.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:33.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:33.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:34.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:33.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:34.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:34.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:34.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:34.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:35.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:35.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:35.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:35.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:36.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:36.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:36.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:36.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:37.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:37.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:37.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:37.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:38.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:38.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:38.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:38.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:39.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:39.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:39.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:39.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:40.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:40.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:40.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:40.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:41.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:41.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:41.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:41.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:42.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:42.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:42.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:42.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:43.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:43.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:43.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:43.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:44.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:44.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:44.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:44.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:45.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:45.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:45.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:45.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:46.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:46.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:46.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:46.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:47.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:47.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:47.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:47.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:48.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:48.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:48.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:48.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:49.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:49.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:49.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:49.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:50.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:50.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:50.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:50.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:51.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:51.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:51.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:51.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:52.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:52.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:52.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:52.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:53.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:53.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:53.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:53.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:54.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:54.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:54.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:54.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:55.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:55.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:55.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:55.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:56.650 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-23T00:04:56.560+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ddecea29e0 msgr2=0x7f81ac040890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-23T00:04:56.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:56.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:56.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:56.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:57.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:57.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:57.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:57.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:58.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:58.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:58.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:58.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:59.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:04:59.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:04:59.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:04:59.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:00.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:00.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:00.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:00.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:01.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:01.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:01.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:01.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:02.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:02.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:02.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:02.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:03.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:03.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:03.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:03.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:04.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:04.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:04.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:04.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:05.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:05.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:05.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:05.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:06.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:06.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:06.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:06.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:07.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:07.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:07.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:07.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:08.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:08.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:08.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:08.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:09.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:09.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:09.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:09.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:10.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:10.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:10.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:10.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:11.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:11.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:11.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:11.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:12.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:12.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:12.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:12.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:13.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:13.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:13.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:13.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:14.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:14.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:14.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:14.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:15.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:15.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:15.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:15.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:16.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:16.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:16.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:16.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:17.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:17.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:17.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:17.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:18.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:18.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:18.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:18.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:19.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:19.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:19.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:19.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:20.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:20.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:20.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:20.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:21.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:21.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:21.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:21.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:22.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:22.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:22.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:22.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:23.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:23.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:23.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:23.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:24.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:24.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:24.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:24.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:25.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:25.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:25.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:25.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:26.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:26.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:26.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:26.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:27.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:27.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:27.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:27.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:28.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:28.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:28.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:28.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:29.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:29.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:29.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:29.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:30.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:30.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:30.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:30.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:31.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:31.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:31.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:31.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:32.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:32.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:32.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:32.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:33.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:33.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:33.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:33.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:34.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:34.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:34.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:34.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:35.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:35.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:35.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:35.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:36.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:36.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:36.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:36.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:37.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:37.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:37.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:37.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:38.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:38.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:38.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:38.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:39.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:39.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:39.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:39.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:40.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:40.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:40.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:40.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:41.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:41.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:41.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:41.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:42.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:42.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:42.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:42.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:43.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:43.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:43.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:43.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:44.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:44.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:44.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:44.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:45.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:45.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:45.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:45.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:46.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:46.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:46.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:46.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:47.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:47.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:47.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:47.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:48.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:48.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:48.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:48.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:49.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:49.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:49.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:49.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:50.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:50.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:50.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:50.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:51.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:51.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:51.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:51.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:52.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:52.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:52.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:52.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:53.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:53.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:54.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:53.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:54.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:54.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:55.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:54.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:55.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:55.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:55.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:55.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:56.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:56.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:56.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:56.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:57.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:57.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:57.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:57.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:58.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:58.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:58.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:58.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:59.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:05:59.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:05:59.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:05:59.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:00.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:00.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:00.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:00.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:01.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:01.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:01.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:01.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:02.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:02.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:02.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:02.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:03.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:03.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:03.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:03.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:04.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:04.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:04.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:04.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:05.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:05.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:05.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:05.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:06.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:06.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:07.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:06.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:07.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:07.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:07.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:07.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:08.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:08.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:09.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:08.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:09.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:09.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:09.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:09.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:10.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:10.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:10.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:10.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:11.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:11.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:11.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:11.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:12.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:12.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:12.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:12.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:13.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:13.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:13.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:13.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:14.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:14.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:14.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:14.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:15.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:15.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:15.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:15.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:16.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:16.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:16.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:16.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:17.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:17.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:17.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:17.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:18.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:18.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:18.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:18.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:19.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:19.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:19.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:19.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:20.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:20.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:20.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:20.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:21.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:21.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:21.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:21.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:22.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:22.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:22.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:22.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:23.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:23.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:23.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:23.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:24.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:24.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:24.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:24.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:25.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:25.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:25.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:25.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:26.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:26.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:26.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:26.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:27.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:27.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:27.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:27.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:28.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:28.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:28.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:28.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:29.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:29.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:29.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:29.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:30.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:30.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:30.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:30.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:31.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:31.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:31.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:31.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:32.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:32.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:32.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:32.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:33.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:33.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:33.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:33.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:34.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:34.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:34.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:34.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:35.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:35.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:35.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:35.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:36.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:36.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:36.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:36.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:37.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:37.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:37.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:37.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:38.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:38.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:38.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:38.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:39.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:39.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:40.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:39.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:40.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:40.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:41.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:40.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:41.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:41.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:41.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:41.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:42.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:42.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:43.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:42.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:43.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:43.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:44.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:43.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:44.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:44.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:45.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:44.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:45.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:45.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:46.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:45.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:46.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:46.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:47.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:46.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:47.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:47.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:47.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:47.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:48.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:48.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:49.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:48.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:49.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:49.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:50.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:49.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:50.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:50.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:51.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:50.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:51.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:51.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:52.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:51.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:52.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:52.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:52.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:52.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:53.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:53.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:53.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:53.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:54.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:54.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:54.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:54.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:55.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:55.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:56.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:55.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:56.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:56.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:57.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:56.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:57.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:57.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:58.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:57.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:58.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:58.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:59.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:06:58.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:06:59.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:06:59.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:00.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:00.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:00.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:00.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:01.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:01.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:01.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:01.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:02.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:02.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:02.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:02.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:03.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:02.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:03.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:03.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:04.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:03.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:04.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:04.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:05.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:04.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:05.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:05.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:06.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:05.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:06.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:06.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:07.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:06.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:07.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:07.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:08.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:07.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:08.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:08.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:09.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:08.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:09.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:09.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:10.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:10.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:10.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:10.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:11.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:11.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:11.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:11.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:12.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:12.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:13.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:12.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:13.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:13.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:14.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:13.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:14.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:14.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:14.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:14.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:15.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:15.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:15.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:15.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:16.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:16.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:16.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:16.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:17.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:17.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:18.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:17.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:18.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:18.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:19.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:18.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:19.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:19.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:20.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:19.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:20.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:19.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:21.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:20.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:21.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:21.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:22.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:22.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:22.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:22.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:23.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:22.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:23.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:23.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:24.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:23.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:24.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:24.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:25.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:24.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:25.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:25.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:26.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:25.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:26.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:26.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:27.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:26.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:27.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:27.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:28.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:28.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:28.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:28.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:29.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:29.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:29.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:29.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:30.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:30.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:30.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:30.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:31.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:31.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:31.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:31.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:32.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:32.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:32.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:32.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:33.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:33.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:33.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:33.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:34.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:34.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:34.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:34.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:35.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:35.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:35.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:35.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:36.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:36.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:36.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:36.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:37.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:37.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:37.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:37.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:38.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:38.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:38.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:38.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:39.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:38.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:39.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:39.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:40.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:39.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:40.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:40.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:40.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:40.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:41.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:41.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:41.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:41.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:42.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:42.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:43.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:42.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:43.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:43.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:44.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:43.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:44.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:44.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:45.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:44.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:45.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:45.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:46.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:45.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:46.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:46.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:47.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:46.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:47.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:47.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:48.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:47.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:48.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:48.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:49.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:48.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:49.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:49.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:50.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:50.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:50.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:50.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:51.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:50.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:51.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:51.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:52.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:51.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:52.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:52.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:53.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:52.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:53.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:53.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:54.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:53.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:54.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:54.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:55.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:54.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:55.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:55.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:56.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:55.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:56.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:56.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:57.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:56.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:57.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:57.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:58.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:57.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:58.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:58.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:59.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:07:59.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:07:59.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:07:59.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:00.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:00.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:00.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:00.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:01.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:01.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:01.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:01.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:02.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:02.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:02.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:02.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:03.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:03.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:03.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:03.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:04.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:04.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:04.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:04.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:05.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:05.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:05.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:05.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:06.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:06.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:06.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:06.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:07.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:07.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:07.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:07.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:08.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:08.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:08.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:08.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:09.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:08.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:09.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:09.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:10.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:09.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:10.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:10.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:11.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:10.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:11.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:11.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:12.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:11.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:12.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:12.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:13.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:12.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:13.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:13.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:14.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:14.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:14.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:14.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:15.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:15.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:15.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:15.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:16.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:16.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:16.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:16.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:17.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:17.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:17.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:17.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:18.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:18.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:18.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:18.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:19.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:18.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:19.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:19.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:20.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:19.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:20.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:20.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:21.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:20.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:21.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:21.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:22.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:21.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:22.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:22.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:23.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:22.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:23.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:23.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:24.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:23.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:24.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:24.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:24.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:24.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:25.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:25.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:26.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:25.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:26.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:26.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:27.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:26.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:27.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:27.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:28.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:27.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:28.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:28.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:29.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:28.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:29.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:29.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:30.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:29.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:30.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:30.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:31.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:30.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:31.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:31.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:32.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:31.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:32.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:32.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:33.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:32.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:33.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:33.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:34.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:33.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:34.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:34.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:35.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:34.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:35.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:35.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:36.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:35.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:36.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:36.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:37.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:36.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:37.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:37.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:38.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:37.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:38.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:38.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:39.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:38.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:39.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:39.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:40.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:39.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:40.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:40.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:41.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:40.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:41.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:41.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:42.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:41.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:42.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:42.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:43.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:42.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:43.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:43.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:44.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:43.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:44.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:44.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:45.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:44.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:45.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:45.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:46.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:45.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:46.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:46.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:47.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:46.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:47.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:47.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:48.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:47.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:48.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:48.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:49.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:49.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:49.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:49.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:50.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:50.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:50.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:50.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:51.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:51.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:51.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:51.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:52.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:52.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:52.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:52.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:53.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:53.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:53.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:53.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:54.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:54.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:54.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:54.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:55.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:55.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:55.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:55.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:56.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:56.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:56.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:56.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:57.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:57.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:57.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:57.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:58.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:58.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:58.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:58.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:59.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:08:59.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:08:59.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:08:59.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:00.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:00.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:00.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:00.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:01.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:01.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:01.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:01.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:01.406 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-23T00:09:01.313+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81ac125ae0 msgr2=0x7f81ac0ca6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-23T00:09:02.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:02.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:02.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:02.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:03.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:03.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:03.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:03.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:04.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:04.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:04.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:04.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:05.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:05.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:05.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:05.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:06.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:06.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:06.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:06.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:07.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:07.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:07.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:07.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:08.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:08.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:08.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:08.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:09.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:09.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:09.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:09.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:10.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:10.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:10.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:10.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:11.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:10.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:11.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:11.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:12.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:11.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:12.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:12.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:13.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:12.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:13.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:13.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:14.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:13.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:14.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:14.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:15.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:14.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:15.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:15.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:15.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:15.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:16.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:16.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:17.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:16.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:17.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:17.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:18.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:17.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:18.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:18.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:19.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:18.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:19.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:19.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:20.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:19.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:20.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:20.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:21.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:20.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:21.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:21.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:22.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:21.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:22.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:22.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:23.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:22.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:23.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:23.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:24.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:24.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:24.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:24.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:25.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:25.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:25.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:25.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:26.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:26.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:26.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:26.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:27.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:27.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:27.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:27.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:28.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:28.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:28.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:28.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:29.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:29.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:29.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:29.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:30.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:30.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:30.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:30.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:31.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:31.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:31.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:31.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:32.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:32.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:32.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:32.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:33.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:33.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:33.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:33.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:34.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:34.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:34.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:34.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:35.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:35.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:35.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:35.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:36.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:36.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:36.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:36.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:37.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:37.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:37.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:37.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:38.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:38.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:38.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:38.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:39.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:39.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:39.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:39.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:40.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:40.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:40.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:40.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:41.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:41.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:41.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:41.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:42.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:42.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:42.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:42.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:43.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:43.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:43.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:43.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:44.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:44.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:44.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:44.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:45.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:45.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:45.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:45.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:46.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:46.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:46.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:46.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:47.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:47.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:47.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:47.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:48.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:48.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:48.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:48.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:49.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:49.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:49.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:49.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:50.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:50.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:50.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:50.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:51.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:51.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:51.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:51.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:52.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:52.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:52.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:52.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:53.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:53.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:53.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:53.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:54.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:54.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:54.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:54.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:55.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:55.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:55.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:55.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:56.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:56.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:56.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:56.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:57.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:57.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:57.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:57.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:58.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:58.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:58.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:58.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:59.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:09:59.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:09:59.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:09:59.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:00.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:00.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:00.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:00.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:01.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:01.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:01.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:01.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:02.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:02.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:02.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:02.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:03.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:03.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:03.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:03.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:04.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:04.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:04.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:04.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:05.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:05.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:05.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:05.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:06.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:06.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:06.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:06.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:07.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:07.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:07.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:07.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:08.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:08.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:08.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:08.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:09.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:09.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:09.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:09.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:10.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:10.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:10.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:10.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:11.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:11.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:11.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:11.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:12.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:12.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:12.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:12.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:13.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:13.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:13.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:13.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:14.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:14.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:14.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:14.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:15.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:15.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:15.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:15.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:16.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:16.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:16.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:16.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:17.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:17.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:17.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:17.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:18.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:18.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:18.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:18.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:19.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:19.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:19.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:19.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:20.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:20.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:20.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:20.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:21.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:21.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:21.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:21.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:22.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:22.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:22.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:22.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:23.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:23.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:23.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:23.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:24.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:24.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:24.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:24.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:25.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:25.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:25.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:25.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:26.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:26.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:26.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:26.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:27.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:27.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:27.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:27.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:28.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:28.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:28.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:28.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:29.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:29.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:29.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:29.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:30.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:30.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:30.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:30.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:31.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:31.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:31.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:31.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:32.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:32.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:32.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:32.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:33.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:33.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:33.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:33.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:34.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:34.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:34.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:34.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:35.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:35.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:35.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:35.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:36.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:36.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:36.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:36.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:37.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:37.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:37.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:37.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:38.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:38.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:38.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:38.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:39.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:39.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:39.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:39.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:40.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:40.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:40.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:40.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:41.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:41.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:41.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:41.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:42.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:42.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:42.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:42.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:43.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:43.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:43.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:43.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:44.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:44.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:44.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:44.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:45.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:45.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:45.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:45.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:46.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:46.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:46.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:46.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:47.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:47.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:47.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:47.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:48.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:48.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:48.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:48.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:49.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:49.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:49.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:49.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:50.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:50.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:50.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:50.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:51.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:51.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:51.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:51.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:52.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:52.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:52.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:52.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:53.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:53.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:53.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:53.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:54.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:54.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:54.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:54.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:55.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:55.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:55.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:55.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:56.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:56.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:56.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:56.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:57.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:57.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:57.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:57.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:58.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:58.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:58.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:58.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:59.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:10:59.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:10:59.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:10:59.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:00.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:00.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:00.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:00.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:01.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:01.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:01.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:01.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:02.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:02.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:02.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:02.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:03.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:03.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:03.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:03.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:04.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:04.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:04.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:04.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:05.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:05.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:05.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:05.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:06.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:06.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:06.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:06.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:07.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:07.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:07.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:07.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:08.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:08.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:08.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:08.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:09.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:09.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:09.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:09.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:10.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:10.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:10.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:10.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:11.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:11.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:11.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:11.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:12.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:12.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:12.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:12.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:13.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:13.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:13.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:13.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:14.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:14.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:14.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:14.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:15.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:15.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:15.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:15.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:16.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:16.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:16.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:16.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:17.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:17.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:17.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:17.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:18.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:18.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:18.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:18.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:19.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:19.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:19.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:19.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:20.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:20.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:20.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:20.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:21.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:21.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:21.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:21.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:22.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:22.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:22.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:22.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:23.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:23.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:23.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:23.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:24.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:24.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:24.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:24.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:25.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:25.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:25.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:25.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:26.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:26.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:26.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:26.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:27.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:27.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:27.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:27.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:28.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:28.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:28.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:28.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:29.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:29.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:29.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:29.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:30.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:30.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:30.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:30.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:31.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:31.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:31.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:31.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:32.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:32.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:32.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:32.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:33.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:33.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:33.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:33.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:34.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:34.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:34.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:34.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:35.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:35.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:35.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:35.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:36.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:36.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:36.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:36.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:37.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:37.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:37.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:37.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:38.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:38.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:38.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:38.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:39.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:39.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:39.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:39.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:40.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:40.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:40.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:40.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:41.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:41.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:41.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:41.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:42.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:42.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:42.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:42.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:43.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:43.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:43.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:43.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:44.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:44.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:44.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:44.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:45.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:45.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:45.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:45.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:46.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:46.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:46.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:46.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:47.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:47.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:47.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:47.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:48.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:48.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:48.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:48.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:49.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:49.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:49.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:49.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:50.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:50.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:50.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:50.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:51.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:51.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:51.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:51.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:52.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:52.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:52.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:52.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:53.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:53.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:53.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:53.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:54.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:54.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:54.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:54.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:55.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:55.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:55.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:55.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:56.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:56.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:56.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:56.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:57.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:57.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:57.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:57.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:58.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:58.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:58.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:58.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:59.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:11:59.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:11:59.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:11:59.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:00.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:00.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:00.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:00.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:01.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:01.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:01.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:01.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:02.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:02.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:02.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:02.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:03.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:03.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:03.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:03.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:04.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:04.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:04.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:04.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:05.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:05.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:05.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:05.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:06.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:06.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:06.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:06.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:07.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:07.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:07.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:07.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:08.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:08.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:08.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:08.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:09.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:09.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:09.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:09.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:10.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:10.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:10.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:10.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:11.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:11.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:11.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:11.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:12.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:12.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:12.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:12.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:13.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:13.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:13.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:13.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:14.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:14.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:14.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:14.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:15.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:15.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:15.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:15.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:16.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:16.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:16.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:16.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:17.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:17.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:17.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:17.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:18.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:18.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:18.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:18.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:19.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:19.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:19.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:19.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:20.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:20.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:20.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:20.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:21.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:21.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:21.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:21.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:22.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:22.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:22.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:22.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:23.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:23.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:23.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:23.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:24.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:24.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:24.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:24.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:25.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:25.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:25.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:25.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:26.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:26.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:26.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:26.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:27.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:27.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:27.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:27.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:28.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:28.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:28.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:28.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:29.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:29.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:29.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:29.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:30.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:30.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:30.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:30.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:31.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:31.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:31.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:31.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:32.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:32.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:32.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:32.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:33.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:33.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:33.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:33.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:34.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:34.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:34.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:34.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:35.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:35.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:35.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:35.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:36.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:36.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:36.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:36.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:37.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:37.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:37.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:37.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:38.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:38.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:38.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:38.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:39.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:39.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:39.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:39.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:40.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:40.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:40.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:40.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:41.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:41.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:41.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:41.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:42.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:42.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:42.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:42.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:43.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:43.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:43.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:43.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:44.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:44.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:44.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:44.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:45.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:45.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:45.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:45.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:46.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:46.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:46.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:46.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:47.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:47.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:47.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:47.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:48.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:48.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:48.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:48.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:49.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:49.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:49.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:49.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:50.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:50.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:50.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:50.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:51.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:51.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:51.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:51.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:52.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:52.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:52.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:52.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:53.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:53.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:53.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:53.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:54.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:54.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:54.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:54.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:55.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:55.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:55.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:55.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:56.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:56.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:56.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:56.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:57.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:57.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:57.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:57.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:58.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:58.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:58.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:58.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:59.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:12:59.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:12:59.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:12:59.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:00.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:00.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:00.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:00.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:01.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:01.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:01.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:01.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:02.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:02.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:02.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:02.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:03.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:03.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:03.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:03.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:04.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:04.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:04.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:04.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:05.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:05.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:05.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:05.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:06.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:06.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:06.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:06.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:07.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:07.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:07.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:07.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:08.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:08.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:08.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:08.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:09.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:09.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:09.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:09.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:10.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:10.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:10.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:10.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:11.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:11.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:11.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:11.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:12.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:12.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:12.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:12.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:13.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:13.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:13.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:13.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:14.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:14.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:14.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:14.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:15.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:15.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:15.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:15.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:16.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:16.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:16.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:16.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:17.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:17.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:17.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:17.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:18.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:18.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:18.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:18.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:19.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:19.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:19.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:19.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:20.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:20.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:20.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:20.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:21.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:21.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:21.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:21.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:22.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:22.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:22.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:22.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:23.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:23.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:23.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:23.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:24.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:24.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:24.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:24.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:25.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:25.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:25.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:25.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:26.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:26.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:26.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:26.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:27.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:27.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:27.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:27.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:28.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:28.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:28.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:28.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:29.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:29.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:29.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:29.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:30.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:30.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:30.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:30.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:31.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:31.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:31.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:31.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:32.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:32.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:32.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:32.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:33.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:33.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:33.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:33.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:34.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:34.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:34.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:34.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:35.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:35.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:35.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:35.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:36.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:36.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:36.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:36.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:37.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:37.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:37.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:37.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:38.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:38.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:38.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:38.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:39.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:39.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:39.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:39.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:40.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:40.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:40.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:40.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:41.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:41.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:41.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:41.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:42.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:42.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:42.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:42.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:43.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:43.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:43.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:43.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:44.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:44.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:45.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:44.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:45.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:45.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:46.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:45.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:46.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:46.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:47.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:46.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:47.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:47.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:48.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:48.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:48.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:48.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:49.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:49.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:49.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:49.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:50.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:50.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:50.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:50.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:51.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:51.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:51.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:51.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:52.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:52.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:52.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:52.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:53.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:53.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:53.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:53.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:54.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:54.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:54.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:54.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:55.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:55.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:55.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:55.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:56.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:56.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:56.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:56.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:57.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:57.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:57.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:57.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:58.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:58.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:58.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:58.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:59.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:13:59.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:13:59.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:13:59.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:00.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:00.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:00.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:00.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:01.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:01.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:01.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:01.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:02.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:02.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:02.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:02.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:03.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:03.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:03.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:03.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:04.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:04.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:04.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:04.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:05.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:05.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:05.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:05.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:06.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:06.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:06.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:06.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:07.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:07.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:07.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:07.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:08.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:08.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:08.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:08.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:09.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:09.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:09.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:09.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:10.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:10.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:10.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:10.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:11.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:11.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:11.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:11.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:12.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:12.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:12.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:12.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:13.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:13.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:13.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:13.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:14.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:14.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:14.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:14.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:15.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:15.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:15.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:15.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:16.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:16.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:16.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:16.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:17.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:17.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:17.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:17.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:18.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:18.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:18.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:18.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:19.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:19.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:19.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:19.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:20.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:20.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:20.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:20.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:21.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:21.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:21.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:21.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:22.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:22.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:22.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:22.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:23.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:23.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:23.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:23.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:24.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:24.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:24.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:24.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:25.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:25.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:25.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:25.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:26.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:26.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:26.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:26.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:27.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:27.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:27.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:27.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:28.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:28.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:28.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:28.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:29.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:29.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:29.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:29.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:30.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:30.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:30.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:30.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:31.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:31.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:31.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:31.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:32.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:32.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:32.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:32.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:33.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:33.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:33.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:33.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:34.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:34.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:34.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:34.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:35.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:35.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:35.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:35.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:36.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:36.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:36.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:36.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:37.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:37.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:37.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:37.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:38.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:38.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:38.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:38.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:39.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:39.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:39.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:39.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:40.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:40.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:40.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:40.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:41.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:41.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:41.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:41.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:42.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:42.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:42.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:42.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:43.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:43.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:43.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:43.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:44.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:44.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:44.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:44.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:45.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:45.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:45.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:45.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:46.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:46.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:46.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:46.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:47.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:47.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:47.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:47.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:48.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:48.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:48.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:48.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:49.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:49.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:49.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:49.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:50.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:50.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:50.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:50.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:51.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:51.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:51.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:51.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:52.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:52.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:52.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:52.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:53.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:53.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:53.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:53.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:54.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:54.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:54.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:54.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:55.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:55.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:55.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:55.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:56.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:56.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:56.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:56.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:57.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:57.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:57.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:57.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:58.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:58.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:58.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:58.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:59.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:14:59.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:14:59.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:14:59.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:00.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:00.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:00.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:00.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:01.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:01.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:01.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:01.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:02.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:02.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:02.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:02.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:03.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:03.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:03.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:03.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:04.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:04.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:04.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:04.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:05.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:05.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:05.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:05.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:06.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:06.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:06.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:06.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:07.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:07.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:07.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:07.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:08.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:08.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:08.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:08.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:09.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:09.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:09.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:09.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:10.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:10.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:10.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:10.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:11.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:11.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:11.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:11.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:12.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:12.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:12.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:12.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:13.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:13.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:13.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:13.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:14.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:14.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:14.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:14.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:15.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:15.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:15.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:15.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:16.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:16.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:16.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:16.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:17.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:17.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:17.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:17.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:18.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:18.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:18.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:18.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:19.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:19.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:19.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:19.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:20.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:20.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:20.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:20.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:21.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:21.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:21.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:21.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:22.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:22.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:22.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:22.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:23.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:23.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:23.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:23.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:24.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:24.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:24.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:24.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:25.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:25.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:25.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:25.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:26.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:26.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:26.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:26.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:27.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:27.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:27.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:27.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:28.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:28.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:28.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:28.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:29.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:29.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:29.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:29.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:30.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:30.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:30.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:30.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:31.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:31.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:31.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:31.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:32.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:32.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:32.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:32.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:33.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:33.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:33.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:33.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:34.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:34.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:34.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:34.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:35.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:35.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:35.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:35.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:36.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:36.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:36.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:36.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:37.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:37.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:37.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:37.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:38.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:38.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:38.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:38.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:39.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:39.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:39.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:39.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:40.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:40.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:40.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:40.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:41.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:41.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:41.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:41.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:42.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:42.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:42.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:42.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:43.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:43.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:43.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:43.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:44.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:44.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:44.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:44.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:45.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:45.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:45.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:45.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:46.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:46.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:46.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:46.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:47.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:47.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:47.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:47.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:48.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:48.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:48.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:48.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:49.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:49.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:49.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:49.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:50.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:50.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:50.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:50.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:51.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:51.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:51.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:51.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:52.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:52.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:52.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:52.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:53.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:53.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:53.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:53.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:54.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:54.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:54.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:54.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:55.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:55.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:55.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:55.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:56.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:56.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:56.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:56.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:57.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:57.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:57.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:57.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:58.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:58.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:58.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:58.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:59.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:15:59.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:15:59.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:15:59.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:00.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:00.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:00.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:00.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:01.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:01.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:02.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:01.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:02.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:02.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:03.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:02.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:03.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:03.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:04.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:03.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:04.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:04.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:05.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:04.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:05.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:05.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:06.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:05.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:06.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:06.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:07.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:06.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:07.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:07.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:08.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:07.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:08.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:08.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:08.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:08.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:09.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:09.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:09.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:09.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:10.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:10.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:10.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:10.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:11.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:11.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:11.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:11.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 114 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:12.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:12.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:12.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:12.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:13.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:13.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:13.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:13.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:14.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:14.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:14.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:14.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:15.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:15.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:15.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:15.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:16.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:16.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:16.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:16.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:17.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:17.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:17.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:17.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:18.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:18.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:18.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:18.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:19.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:19.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:19.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:19.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:20.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:20.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:20.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:20.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:21.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:21.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:21.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:21.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:22.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:22.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:22.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:22.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:23.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:23.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:23.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:23.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:24.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:24.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:24.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:24.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:25.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:25.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:25.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:25.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:26.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:26.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:26.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:26.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:27.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:27.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:27.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:27.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:28.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:28.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:28.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:28.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:29.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:29.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:29.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:29.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:30.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:30.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:30.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:30.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:31.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:31.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:31.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:31.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:32.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:32.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:32.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:32.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:33.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:33.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:33.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:33.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:34.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:34.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:34.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:34.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:35.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:35.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:35.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:35.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:36.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:36.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:36.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:36.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:37.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:37.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:37.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:37.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:38.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:38.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:38.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:38.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:39.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:39.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:39.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:39.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:40.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:40.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:40.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:40.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:41.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:41.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:16:41.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:41.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:42.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:42.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:42.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:42.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:43.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:43.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:43.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:43.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:44.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:44.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:44.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:44.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:45.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:45.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:45.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:45.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:46.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:46.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:46.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:46.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:47.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:47.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:47.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:47.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:48.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:48.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:48.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:48.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:49.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:49.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:49.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:49.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:50.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:50.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:51.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:50.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:51.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:51.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:52.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:52.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:52.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:52.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:53.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:53.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:53.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:53.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:54.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:53.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:54.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:54.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:55.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:54.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:55.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:55.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:56.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:56.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:56.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:56.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:57.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:57.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:57.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:57.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:58.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:58.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:58.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:58.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:59.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:16:59.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:16:59.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:16:59.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:00.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:00.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:01.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:00.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:01.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:01.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:02.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:01.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:02.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:01.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:03.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:02.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:03.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:03.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:04.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:03.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:04.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:04.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:04.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:04.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:05.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:05.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:06.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:05.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:06.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:06.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:07.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:06.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:07.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:07.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:07.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:07.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:08.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:08.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:08.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:08.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:09.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:09.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:10.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:09.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:10.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:09.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:11.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:10.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:11.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:10.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:12.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:11.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:12.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:12.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:13.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:12.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:13.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:13.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:14.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:13.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:14.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:14.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:15.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:15.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:15.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:15.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:16.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:16.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:16.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:16.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:17.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:17.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:17.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:17.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:18.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:18.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:18.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:18.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:19.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:18.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:19.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:19.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:19.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:19.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:20.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:20.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:21.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:20.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:21.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:21.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:22.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:21.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:22.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:22.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:22.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:22.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:23.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:23.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:23.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:23.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:24.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:24.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:24.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:24.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:25.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:25.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:25.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:25.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:26.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:26.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:26.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:26.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:27.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:27.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:27.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:27.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:28.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:28.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:28.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:28.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:29.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:29.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:29.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:29.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:30.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:30.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:30.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:30.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:31.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:31.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:31.952 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:31.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:32.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:32.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:32.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:32.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:33.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:33.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:34.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:33.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:34.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:34.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:35.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:35.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:35.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:35.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:36.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:36.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:36.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:36.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:37.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:37.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:37.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:37.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:38.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:38.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:38.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:38.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:39.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:39.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:39.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:39.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:40.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:40.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:40.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:40.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:41.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:41.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:41.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:41.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:42.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:42.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:42.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:42.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:43.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:43.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:43.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:43.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:44.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:44.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:44.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:44.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:45.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:45.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:45.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:45.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:46.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:45.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:46.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:46.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:47.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:47.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:47.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:47.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:48.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:48.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:48.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:48.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:49.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:48.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:49.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:49.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:50.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:50.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:50.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:50.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:51.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:51.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:51.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:51.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:52.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:51.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:52.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:52.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:53.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:52.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:53.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:53.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:54.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:54.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:54.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:54.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:55.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:54.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:55.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:55.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:56.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:55.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:56.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:56.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:57.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:56.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:57.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:57.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:57.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:57.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:58.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:57.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:59.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:58.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:59.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:58.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:17:59.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:17:59.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:00.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:17:59.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:01.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:00.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:01.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:01.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:02.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:01.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:02.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:02.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:03.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:02.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:03.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:03.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:04.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:03.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:04.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:03.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:05.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:04.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:05.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:04.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:05.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:05.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:06.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:05.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:06.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:06.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:06.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:06.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:07.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:07.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:07.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:07.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:08.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:08.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:08.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:08.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:09.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:09.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:09.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:09.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:10.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:10.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:11.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:10.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:11.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:11.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:12.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:11.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:12.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:12.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:13.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:12.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:13.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:13.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:14.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:13.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:14.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:14.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:15.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:14.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:15.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:15.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:16.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:15.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:16.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:16.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:17.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:17.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:17.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:17.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:18.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:17.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:18.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:18.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:19.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:19.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:19.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:19.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:20.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:19.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:20.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:20.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:21.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:21.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:21.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:21.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:22.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:21.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:22.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:22.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:23.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:22.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:23.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:23.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:23.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:23.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:24.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:24.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:25.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:25.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:25.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:25.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:26.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:25.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:26.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:26.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:27.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:26.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:27.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:27.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:28.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:28.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:28.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:28.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:29.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:28.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:29.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:29.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:30.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:29.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:30.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:30.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:31.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:30.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:31.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:31.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:32.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:32.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:32.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:32.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:33.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:33.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:33.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:33.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:34.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:34.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:34.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:34.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:35.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:35.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:35.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:35.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:36.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:36.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:36.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:36.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:37.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:37.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:37.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:37.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:38.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:38.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:38.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:38.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:39.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:39.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:39.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:39.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:40.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:40.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:40.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:40.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:41.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:41.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:41.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:41.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:42.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:42.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:42.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:42.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:43.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:43.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:44.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:43.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:44.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:44.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:44.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:44.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:45.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:45.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:46.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:45.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:46.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:46.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:47.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:46.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:47.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:47.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:48.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:47.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:48.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:48.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:49.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:48.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:49.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:49.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:50.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:49.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:50.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:50.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:50.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:50.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:51.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:51.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:51.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:51.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:52.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:52.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:52.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:52.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:53.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:53.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:53.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:53.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:54.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:54.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:54.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:54.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:55.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:55.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:55.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:55.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:56.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:56.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:57.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:56.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:57.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:57.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:58.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:58.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:58.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:58.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:59.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:18:59.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:18:59.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:18:59.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:00.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:00.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:00.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:00.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:01.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:01.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:01.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:01.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:02.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:02.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:02.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:02.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:03.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:03.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:03.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:03.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:04.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:03.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:04.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:04.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:04.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:04.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:05.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:05.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:05.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:05.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:06.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:06.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:06.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:06.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:07.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:07.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:08.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:07.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:08.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:08.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:09.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:09.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:09.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:09.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:10.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:10.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:10.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:10.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:11.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:10.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:11.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:11.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:11.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:11.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:12.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:12.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:13.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:12.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:13.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:13.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:14.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:13.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:14.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:14.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:15.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:14.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:15.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:15.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:15.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:15.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:16.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:16.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:16.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:16.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:17.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:17.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:17.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:17.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:18.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:18.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:18.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:18.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:19.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:19.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:19.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:19.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:20.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:20.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:21.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:20.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:21.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:21.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:22.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:21.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:22.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:22.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:22.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:22.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:23.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:23.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:23.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:23.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:24.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:24.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:24.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:24.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:25.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:25.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:25.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:25.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:26.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:26.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:26.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:26.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:27.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:27.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:27.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:27.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:28.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:28.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:28.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:28.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:29.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:29.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:29.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:29.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:30.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:30.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:30.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:30.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:31.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:31.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:31.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:31.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:32.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:32.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:32.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:32.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:33.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:33.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:33.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:33.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:34.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:34.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:34.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:34.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:35.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:35.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:35.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:35.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:36.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:36.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:36.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:36.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:37.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:37.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:37.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:37.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:38.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:38.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:38.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:38.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:39.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:39.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:39.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:39.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:40.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:40.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:40.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:40.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:41.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:41.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:41.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:41.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:42.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:42.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:42.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:42.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:43.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:43.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:43.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:43.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:44.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:44.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:44.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:44.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:45.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:45.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:45.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:45.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:46.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:46.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:46.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:46.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:47.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:47.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:48.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:47.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:48.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:48.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:49.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:48.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:49.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:49.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:50.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:49.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:50.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:50.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:51.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:50.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:51.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:51.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:52.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:52.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:52.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:52.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:53.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:53.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:53.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:53.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:54.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:53.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:54.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:54.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:55.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:54.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:55.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:55.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:56.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:55.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:56.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:56.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:57.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:57.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:57.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:57.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:58.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:58.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:58.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:58.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:59.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:19:59.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:19:59.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:19:59.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:00.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:00.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:00.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:00.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:01.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:01.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:01.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:01.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:02.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:02.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:02.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:02.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:03.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:03.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:03.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:03.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:04.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:04.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:04.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:04.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:05.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:05.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:05.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:05.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:06.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:06.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:06.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:06.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:07.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:07.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:07.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:07.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:08.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:08.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:08.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:08.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:09.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:09.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:09.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:09.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:10.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:10.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:10.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:10.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:11.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:11.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:11.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:11.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:12.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:12.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:12.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:12.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:13.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:13.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:13.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:13.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:14.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:14.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:14.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:14.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:15.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:15.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:15.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:15.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:16.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:16.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:16.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:16.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:17.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:17.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:17.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:17.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:18.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:18.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:18.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:18.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:19.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:19.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:19.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:19.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:20.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:20.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:20.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:20.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:21.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:21.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:21.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:21.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:22.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:22.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:22.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:22.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:23.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:23.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:23.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:23.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:24.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:24.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:24.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:24.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:25.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:25.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:25.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:25.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:26.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:26.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:26.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:26.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:27.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:27.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:27.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:27.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:28.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:28.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:28.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:28.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:29.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:29.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:29.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:29.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:30.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:30.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:30.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:30.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:31.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:31.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:31.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:31.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:32.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:32.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:32.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:32.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:33.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:33.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:33.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:33.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:34.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:34.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:34.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:34.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:35.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:35.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:35.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:35.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:36.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:36.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:36.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:36.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:37.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:37.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:37.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:37.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:38.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:38.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:38.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:38.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:39.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:39.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:39.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:39.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:40.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:40.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:40.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:40.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:41.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:41.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:41.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:41.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:42.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:42.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:42.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:42.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:43.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:43.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:43.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:43.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:44.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:44.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:44.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:44.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:45.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:45.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:45.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:45.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:46.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:46.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:46.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:46.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:47.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:47.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:47.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:47.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:48.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:48.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:48.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:48.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:49.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:49.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:49.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:49.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:50.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:50.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:50.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:50.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:51.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:51.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:51.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:51.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:52.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:52.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:52.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:52.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:53.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:53.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:53.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:53.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:54.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:54.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:54.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:54.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:55.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:55.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:55.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:55.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:56.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:56.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:56.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:56.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:57.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:57.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:57.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:57.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:58.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:58.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:58.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:58.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:59.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:20:59.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:20:59.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:20:59.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:00.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:00.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:00.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:00.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:01.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:01.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:01.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:01.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:02.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:02.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:02.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:02.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:03.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:03.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:03.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:03.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:04.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:04.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:04.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:04.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:05.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:05.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:05.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:05.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:06.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:06.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:06.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:06.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:07.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:07.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:07.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:07.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:08.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:08.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:08.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:08.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:09.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:09.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:09.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:09.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:10.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:10.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:10.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:10.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:11.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:11.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:11.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:11.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:12.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:12.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:12.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:12.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:13.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:13.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:13.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:13.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:14.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:14.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:14.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:14.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:15.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:15.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:15.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:15.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:16.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:16.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:16.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:16.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:17.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:17.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:17.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:17.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:18.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:18.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:18.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:18.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:19.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:19.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:19.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:19.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:20.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:20.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:20.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:20.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:21.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:21.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:21.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:21.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:22.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:22.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:22.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:22.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:23.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:23.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:23.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:23.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:24.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:24.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:24.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:24.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:25.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:25.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:25.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:25.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:26.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:26.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:26.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:26.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:27.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:27.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:27.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:27.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:28.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:28.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:28.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:28.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:29.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:29.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:29.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:29.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:30.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:30.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:30.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:30.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:31.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:31.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:31.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:31.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:32.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:32.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:32.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:32.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:33.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:33.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:33.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:33.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:34.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:34.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:34.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:34.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:35.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:35.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:35.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:35.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:36.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:36.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:36.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:36.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:37.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:37.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:37.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:37.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:38.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:38.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:38.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:38.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:39.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:39.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:39.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:39.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:40.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:40.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:40.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:40.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:41.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:41.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:41.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:41.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:42.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:42.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:42.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:42.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:43.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:43.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:43.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:43.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:44.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:44.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:44.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:44.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:45.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:45.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:45.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:45.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:46.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:46.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:46.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:46.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:47.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:47.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:47.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:47.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:48.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:48.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:48.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:48.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:49.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:49.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:49.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:49.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:50.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:50.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:50.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:50.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:51.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:51.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:51.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:51.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:52.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:52.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:52.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:52.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:53.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:53.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:53.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:53.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:54.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:54.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:54.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:54.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:55.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:55.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:55.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:55.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:56.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:56.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:56.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:56.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:57.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:57.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:57.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:57.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:58.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:58.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:58.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:58.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:59.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:21:59.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:21:59.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:21:59.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:00.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:00.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:00.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:00.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:01.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:01.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:01.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:01.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:02.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:02.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:02.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:02.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:03.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:03.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:03.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:03.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:04.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:04.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:04.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:04.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:05.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:05.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:05.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:05.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:06.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:06.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:06.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:06.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:07.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:07.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:07.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:07.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:08.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:08.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:08.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:08.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:09.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:09.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:09.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:09.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:10.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:10.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:10.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:10.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:11.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:11.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:11.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:11.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:12.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:12.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:12.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:12.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:13.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:13.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:13.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:13.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:14.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:14.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:14.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:14.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:15.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:15.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:15.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:15.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:16.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:16.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:16.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:16.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:17.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:17.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:17.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:17.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:18.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:18.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:18.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:18.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:19.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:19.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:19.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:19.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:20.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:20.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:20.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:20.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:21.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:21.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:21.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:21.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:22.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:22.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:22.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:22.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:23.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:23.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:23.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:23.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:24.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:24.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:24.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:24.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:25.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:25.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:25.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:25.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:26.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:26.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:26.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:26.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:27.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:27.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:27.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:27.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:28.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:28.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:28.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:28.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:29.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:29.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:29.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:29.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:30.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:30.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:30.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:30.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:31.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:31.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:31.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:31.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:32.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:32.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:32.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:32.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:33.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:33.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:33.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:33.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:34.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:34.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:34.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:34.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:35.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:35.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:35.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:35.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:36.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:36.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:36.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:36.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:37.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:37.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:37.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:37.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:38.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:38.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:38.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:38.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:39.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:39.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:39.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:39.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:40.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:40.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:40.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:40.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:41.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:41.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:41.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:41.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:42.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:42.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:42.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:42.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:43.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:43.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:43.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:43.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:44.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:44.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:44.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:44.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:45.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:45.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:45.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:45.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:46.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:46.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:46.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:46.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:47.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:47.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:47.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:47.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:48.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:48.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:48.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:48.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:49.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:48.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:49.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:49.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:50.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:49.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:50.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:50.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:51.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:50.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:51.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:51.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:52.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:51.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:52.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:52.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:53.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:53.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:53.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:53.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:54.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:54.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:54.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:54.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:55.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:54.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:55.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:55.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:56.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:56.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:56.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:56.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:57.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:57.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:57.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:57.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:58.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:58.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:58.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:58.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:59.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:58.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:59.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:22:59.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:22:59.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:22:59.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:00.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:00.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:00.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:00.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:01.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:01.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:01.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:01.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:02.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:02.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:02.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:02.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:03.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:03.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:03.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:03.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:04.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:04.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:04.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:04.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:05.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:05.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:05.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:05.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:06.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:06.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:06.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:06.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:07.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:07.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:07.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:07.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:08.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:08.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:08.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:08.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:09.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:09.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:09.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:09.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:10.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:10.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:10.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:10.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:11.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:11.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:11.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:11.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:12.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:12.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:13.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:12.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:13.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:13.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:14.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:13.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:14.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:14.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:14.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:14.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:15.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:15.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:16.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:15.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:16.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:16.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:16.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:16.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:17.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:17.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:17.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:17.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:18.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:18.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:18.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:18.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:19.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:19.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:19.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:19.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:20.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:20.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:20.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:20.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:21.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:21.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:21.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:21.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:22.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:22.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:23.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:22.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:23.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:23.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:24.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:24.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:24.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:24.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:25.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:25.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:25.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:25.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:26.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:26.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:26.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:26.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:27.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:27.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:27.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:27.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:28.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:27.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:28.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:28.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:29.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:28.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:29.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:29.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:29.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:29.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:30.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:30.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:31.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:30.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:31.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:31.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:32.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:31.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:32.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:32.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:32.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:32.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:33.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:33.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:33.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:33.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:34.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:34.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:34.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:34.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:35.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:35.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:36.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:35.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:36.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:36.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:37.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:36.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:37.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:37.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:38.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:38.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:38.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:38.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:39.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:39.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:39.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:39.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:40.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:40.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:40.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:40.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:41.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:41.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:41.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:41.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:42.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:42.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:42.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:42.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:43.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:43.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:43.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:43.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:44.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:44.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:44.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:44.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:45.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:45.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:45.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:45.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:46.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:46.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:46.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:46.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:47.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:47.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:47.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:47.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:48.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:48.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:48.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:48.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:49.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:49.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:49.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:49.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:50.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:50.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:50.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:50.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:51.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:51.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:51.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:51.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:52.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:52.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:52.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:52.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:53.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:53.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:53.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:53.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:54.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:54.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:54.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:54.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:55.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:55.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:55.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:55.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:56.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:56.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:56.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:56.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:57.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:57.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:57.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:57.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:58.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:58.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:58.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:58.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:59.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:23:59.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:23:59.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:23:59.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:00.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:00.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:00.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:00.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:01.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:01.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:01.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:01.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:02.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:02.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:02.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:02.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:03.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:03.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:03.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:03.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:04.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:04.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:04.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:04.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:05.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:05.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:05.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:05.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:06.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:06.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:06.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:06.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:07.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:07.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:07.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:07.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:08.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:08.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:08.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:08.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:09.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:09.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:09.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:09.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:10.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:10.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:10.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:10.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:11.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:11.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:11.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:11.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:12.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:12.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:12.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:12.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:13.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:13.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:13.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:13.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:14.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:14.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:14.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:14.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:15.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:15.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:15.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:15.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:16.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:16.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:16.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:16.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:17.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:17.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:17.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:17.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:18.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:18.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:18.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:18.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:19.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:19.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:19.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:19.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:20.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:20.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:20.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:20.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:21.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:21.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:21.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:21.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:22.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:22.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:22.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:22.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:23.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:23.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:23.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:23.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:24.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:24.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:24.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:24.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:25.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:25.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:25.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:25.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:26.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:26.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:26.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:26.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:27.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:27.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:27.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:27.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:28.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:28.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:28.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:28.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:29.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:29.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:29.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:29.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:30.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:30.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:30.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:30.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:31.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:31.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:31.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:31.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:32.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:32.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:32.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:32.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:33.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:33.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:33.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:33.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:34.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:34.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:34.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:34.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:35.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:35.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:35.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:35.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:36.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:36.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:36.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:36.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:37.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:37.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:37.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:37.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:38.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:38.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:38.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:38.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:39.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:39.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:39.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:39.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:40.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:40.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:40.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:40.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:41.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:41.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:41.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:41.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:42.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:42.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:42.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:42.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:43.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:43.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:43.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:43.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:44.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:44.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:44.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:44.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:45.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:45.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:45.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:45.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:46.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:46.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:46.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:46.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:47.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:47.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:47.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:47.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:48.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:48.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:48.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:48.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:49.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:49.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:49.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:49.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:50.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:50.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:50.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:50.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:51.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:51.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:51.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:51.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:52.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:52.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:52.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:52.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:53.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:53.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:53.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:53.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:54.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:54.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:54.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:54.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:55.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:55.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:55.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:55.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:56.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:56.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:56.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:56.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:57.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:57.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:57.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:57.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:58.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:58.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:58.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:58.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:59.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:24:59.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:24:59.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:24:59.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:00.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:00.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:00.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:00.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:01.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:01.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:01.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:01.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:02.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:02.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:02.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:02.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:03.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:03.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:03.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:03.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:04.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:04.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:04.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:04.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:05.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:05.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:05.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:05.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:06.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:06.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:06.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:06.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:07.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:07.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:07.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:07.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:08.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:08.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:08.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:08.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:09.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:09.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:09.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:09.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:10.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:10.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:10.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:10.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:11.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:11.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:11.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:11.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:12.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:12.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:12.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:12.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:13.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:13.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:13.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:13.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:14.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:14.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:14.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:14.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:15.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:15.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:15.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:15.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:16.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:16.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:16.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:16.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:17.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:17.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:17.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:17.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:18.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:18.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:18.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:18.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:19.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:19.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:19.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:19.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:20.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:20.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:20.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:20.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:21.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:21.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:21.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:21.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:22.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:22.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:22.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:22.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:23.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:23.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:23.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:23.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:24.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:24.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:24.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:24.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:25.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:25.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:25.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:25.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:26.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:26.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:26.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:26.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:27.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:27.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:27.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:27.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:28.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:28.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:28.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:28.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:29.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:29.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:30.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:29.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:30.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:30.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:31.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:31.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:31.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:31.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:31.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:31.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:32.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:32.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:33.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:32.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:33.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:33.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:34.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:33.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:34.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:34.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:35.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:34.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:35.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:35.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:35.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:35.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:36.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:36.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:36.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:36.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:37.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:37.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:37.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:37.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:38.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:38.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:38.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:38.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:39.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:39.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:39.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:39.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:40.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:40.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:40.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:40.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:41.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:41.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:41.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:41.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:42.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:42.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:42.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:42.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:43.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:43.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:43.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:43.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:44.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:44.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:44.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:44.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:45.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:45.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:45.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:45.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:46.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:46.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:46.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:46.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:47.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:47.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:47.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:47.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:48.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:48.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:48.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:48.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:49.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:49.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:49.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:49.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:50.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:50.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:51.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:51.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:51.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:51.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:52.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:52.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:52.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:52.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:53.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:52.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:53.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:53.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:53.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:53.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:54.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:54.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:54.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:54.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:55.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:55.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:55.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:55.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:56.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:56.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:56.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:56.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:57.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:57.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:57.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:57.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:58.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:58.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:58.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:58.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:59.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:25:59.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:25:59.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:25:59.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:00.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:00.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:00.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:00.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:01.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:01.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:01.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:01.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:02.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:02.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:03.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:02.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:03.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:03.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:03.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:03.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:04.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:04.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:05.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:04.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:05.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:05.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:06.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:06.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:06.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:06.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:07.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:07.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:07.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:07.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:08.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:08.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:08.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:08.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:09.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:09.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:09.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:09.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:10.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:09.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:10.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:10.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:11.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:10.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:11.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:11.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:12.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:12.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:12.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:12.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:13.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:12.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:13.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:13.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:14.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:14.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:14.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:14.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:14.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:14.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:15.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:15.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:16.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:15.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:16.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:16.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:17.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:17.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:17.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:17.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:18.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:18.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:18.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:18.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:19.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:19.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:19.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:19.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:20.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:20.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:20.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:20.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:21.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:21.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:21.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:21.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:22.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:22.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:22.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:22.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:23.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:23.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:23.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:23.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:24.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:24.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:24.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:24.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:25.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:25.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:25.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:25.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:26.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:25.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:26.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:26.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:27.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:26.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:27.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:27.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:28.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:28.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:28.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:28.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:29.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:29.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:29.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:29.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:30.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:30.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:30.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:30.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:31.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:31.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:31.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:31.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:32.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:32.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:32.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:32.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:33.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:33.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:33.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:33.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:34.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:34.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:34.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:34.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:35.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:35.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:35.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:35.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:36.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:35.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:36.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:36.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:36.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:36.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:37.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:37.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:37.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:37.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:38.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:38.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:38.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:38.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:39.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:39.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:39.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:39.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:40.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:40.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:40.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:40.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:41.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:41.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:41.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:41.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:42.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:42.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:42.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:42.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:43.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:43.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:43.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:43.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:44.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:44.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:44.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:44.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:45.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:45.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:45.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:45.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:46.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:46.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:46.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:46.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:47.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:47.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:47.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:47.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:48.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:48.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:48.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:48.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:49.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:49.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:49.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:49.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:50.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:50.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:50.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:50.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:51.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:51.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:51.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:51.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:52.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:52.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:52.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:52.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:53.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:53.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:53.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:53.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:54.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:54.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:54.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:54.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:55.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:55.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:55.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:55.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:56.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:56.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:56.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:56.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:57.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:57.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:57.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:57.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:58.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:58.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:58.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:26:58.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:26:59.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:26:59.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:00.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:00.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:00.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:00.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:01.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:01.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:01.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:01.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:02.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:02.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:02.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:02.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:03.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:03.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:03.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:03.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:04.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:04.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:04.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:04.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:05.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:05.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:05.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:05.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:06.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:06.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:06.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:06.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:07.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:07.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:07.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:07.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:08.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:08.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:08.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:08.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:09.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:09.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:09.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:09.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:10.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:10.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:10.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:10.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:11.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:11.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:11.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:11.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:12.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:12.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:12.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:12.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:13.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:13.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:13.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:13.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:14.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:13.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:14.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:14.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:15.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:14.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:15.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:15.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:16.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:15.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:16.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:16.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:17.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:17.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:17.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:17.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:18.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:18.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:18.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:18.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:19.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:19.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:19.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:19.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:20.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:20.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:20.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:20.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:21.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:21.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:21.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:21.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:22.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:22.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:22.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:22.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:23.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:23.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:23.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:23.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:24.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:24.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:24.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:24.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:25.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:25.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:25.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:25.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:26.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:26.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:26.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:26.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:27.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:27.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:27.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:27.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:28.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:28.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:28.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:28.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:29.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:29.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:29.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:29.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:30.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:30.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:30.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:30.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:31.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:31.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:31.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:31.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:32.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:32.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:32.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:32.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:33.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:33.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:33.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:33.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:34.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:34.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:34.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:34.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:35.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:35.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:35.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:35.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:36.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:36.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:36.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:36.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:37.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:37.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:37.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:37.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:38.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:38.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:38.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:38.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:39.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:39.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:39.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:39.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:40.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:40.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:40.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:40.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:41.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:41.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:41.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:41.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:42.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:42.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:42.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:42.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:43.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:43.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:43.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:43.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:44.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:44.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:44.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:44.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:45.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:45.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:45.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:45.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:46.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:46.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:46.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:46.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:47.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:47.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:47.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:47.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:48.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:48.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:48.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:48.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:49.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:49.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:49.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:49.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:50.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:50.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:50.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:50.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:51.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:51.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:51.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:51.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:52.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:52.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:52.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:52.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:53.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:53.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:53.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:53.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:54.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:54.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:54.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:54.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:55.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:55.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:55.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:55.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:56.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:56.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:56.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:56.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:57.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:57.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:57.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:57.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:58.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:58.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:58.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:58.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:59.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:27:59.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:27:59.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:27:59.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:00.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:00.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:00.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:00.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:01.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:01.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:01.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:01.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:02.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:02.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:02.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:02.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:03.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:03.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:03.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:03.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:04.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:04.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:04.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:04.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:05.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:05.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:05.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:05.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:06.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:06.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:06.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:06.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:07.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:07.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:07.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:07.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:08.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:08.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:08.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:08.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:09.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:09.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:09.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:09.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:10.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:10.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:10.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:10.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:11.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:11.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:11.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:11.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:12.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:12.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:12.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:12.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:13.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:13.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:13.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:13.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:14.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:14.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:14.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:14.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:15.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:15.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:15.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:15.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:16.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:16.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:16.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:16.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:17.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:17.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:17.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:17.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:18.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:18.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:18.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:18.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:19.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:19.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:19.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:19.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:20.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:20.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:20.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:20.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:21.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:21.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:21.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:21.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:22.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:22.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:22.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:22.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:23.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:23.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:23.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:23.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:24.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:24.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:24.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:24.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:25.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:25.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:25.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:25.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:26.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:26.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:26.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:26.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:27.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:27.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:27.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:27.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:28.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:28.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:28.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:28.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:29.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:29.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:29.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:29.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:30.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:30.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:30.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:30.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:31.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:31.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:31.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:31.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:32.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:32.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:32.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:32.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:33.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:33.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:33.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:33.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:34.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:34.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:34.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:34.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:35.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:35.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:35.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:35.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:36.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:36.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:36.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:36.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:37.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:37.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:37.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:37.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:38.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:38.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:38.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:38.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:39.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:39.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:39.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:39.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:40.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:40.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:40.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:40.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:41.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:41.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:41.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:41.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:42.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:42.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:42.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:42.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:43.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:43.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:43.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:43.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:44.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:44.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:44.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:44.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:45.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:45.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:45.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:45.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:46.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:46.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:46.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:46.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:47.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:47.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:47.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:47.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:48.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:48.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:48.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:48.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:49.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:49.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:49.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:49.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:50.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:50.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:50.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:50.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:50.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:50.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:51.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:51.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:52.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:51.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:52.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:52.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:52.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:52.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:53.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:53.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:53.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:53.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:54.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:54.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:54.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:54.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:55.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:55.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:55.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:55.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:56.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:56.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:56.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:56.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:57.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:57.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:57.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:57.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:58.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:58.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:58.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:58.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:59.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:28:59.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:28:59.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:28:59.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:00.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:00.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:00.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:00.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:01.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:01.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:01.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:01.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:02.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:02.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:02.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:02.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:03.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:03.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:03.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:03.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:04.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:04.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:04.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:04.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:05.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:05.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:05.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:05.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:06.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:06.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:06.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:06.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:07.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:07.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:07.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:07.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:08.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:08.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:08.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:08.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:09.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:09.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:09.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:09.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:10.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:10.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:10.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:10.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:11.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:11.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:11.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:11.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:12.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:12.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:12.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:12.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:13.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:13.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:13.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:13.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:14.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:14.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:14.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:14.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:15.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:15.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:15.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:15.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:16.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:16.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:16.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:16.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:17.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:17.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:17.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:17.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:18.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:18.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:18.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:18.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:19.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:19.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:19.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:19.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:20.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:20.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:20.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:20.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:21.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:21.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:22.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:21.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:22.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:22.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:23.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:23.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:23.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:23.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:24.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:24.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:24.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:24.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:25.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:25.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:25.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:25.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:26.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:26.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:26.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:26.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:27.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:27.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:27.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:27.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:28.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:28.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:28.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:28.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:29.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:29.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:29.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:29.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:30.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:30.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:30.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:30.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:31.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:31.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:31.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:31.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:32.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:32.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:32.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:32.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:33.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:33.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:33.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:33.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:34.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:34.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:34.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:34.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:35.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:35.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:35.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:35.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:36.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:36.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:36.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:36.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:37.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:37.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:37.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:37.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:38.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:38.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:38.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:38.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:39.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:39.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:39.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:39.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:40.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:40.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:40.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:40.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:41.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:41.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:41.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:41.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:42.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:42.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:42.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:42.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:43.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:43.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:43.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:43.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:44.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:44.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:44.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:44.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:45.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:45.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:45.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:45.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:46.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:46.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:46.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:46.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:47.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:47.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:47.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:47.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:48.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:48.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:49.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:49.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:49.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:49.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:50.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:50.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:50.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:50.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:51.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:51.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:51.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:51.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:52.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:52.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:52.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:52.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:53.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:53.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:53.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:53.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:54.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:54.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:54.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:54.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:55.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:55.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:55.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:55.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:56.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:56.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:56.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:56.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:57.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:56.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:57.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:57.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:58.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:58.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:58.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:58.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:59.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:29:59.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:29:59.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:29:59.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:00.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:00.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:00.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:00.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:01.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:01.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:01.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:01.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:02.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:01.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:02.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:02.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:03.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:02.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:03.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:03.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:04.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:04.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:04.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:04.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:05.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:05.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:05.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:05.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:06.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:06.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:06.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:06.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:07.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:07.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:07.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:07.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:08.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:08.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:08.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:08.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:09.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:09.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:09.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:09.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:10.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:10.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:10.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:10.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:11.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:11.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:11.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:11.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:12.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:12.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:12.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:12.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:13.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:13.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:13.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:13.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:14.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:14.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:14.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:14.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:15.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:15.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:15.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:15.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:16.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:16.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:16.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:16.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:17.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:17.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:17.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:17.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:18.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:18.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:18.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:18.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:19.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:19.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:19.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:19.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:20.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:20.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:20.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:20.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:21.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:21.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:21.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:21.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:22.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:22.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:22.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:22.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:23.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:23.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:23.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:23.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:24.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:24.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:24.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:24.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:25.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:25.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:25.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:25.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:26.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:26.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:26.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:26.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:27.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:27.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:27.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:27.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:28.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:28.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:28.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:28.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:29.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:29.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:29.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:29.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:30.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:30.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:30.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:30.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:31.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:31.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:31.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:31.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:32.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:32.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:32.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:32.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:33.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:33.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:33.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:33.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:34.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:34.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:34.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:34.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:35.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:35.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:35.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:35.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:36.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:36.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:36.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:36.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:37.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:37.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:37.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:37.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:38.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:38.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:38.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:38.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:39.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:39.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:39.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:39.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:40.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:40.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:40.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:40.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:41.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:41.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:41.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:41.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:42.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:42.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:42.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:42.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:43.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:43.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:43.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:43.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:44.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:44.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:44.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:44.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:45.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:45.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:45.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:45.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:46.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:46.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:46.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:46.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:47.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:47.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:47.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:47.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:48.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:48.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:48.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:48.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:49.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:49.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:49.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:49.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:50.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:50.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:50.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:50.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:51.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:51.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:51.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:51.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:52.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:52.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:52.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:52.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:53.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:53.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:53.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:53.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:54.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:54.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:54.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:54.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:55.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:55.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:55.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:55.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:56.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:56.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:56.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:56.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:57.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:57.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:57.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:57.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:58.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:58.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:58.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:58.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:59.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:30:59.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:30:59.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:30:59.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:00.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:00.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:00.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:00.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:01.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:01.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:01.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:01.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:02.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:02.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:02.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:02.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:03.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:03.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:03.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:03.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:04.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:04.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:04.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:04.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:05.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:05.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:05.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:05.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:06.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:06.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:06.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:06.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:07.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:07.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:07.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:07.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:08.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:08.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:08.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:08.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:09.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:09.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:09.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:09.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:10.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:10.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:10.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:10.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:11.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:11.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 117 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:11.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:11.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:12.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:12.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:12.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:12.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:13.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:13.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:13.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:13.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:14.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:14.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:14.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:14.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:15.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:15.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:15.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:15.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:16.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:16.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:16.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:16.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:17.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:17.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:17.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:17.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:18.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:18.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:18.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:18.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:19.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:19.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:19.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:19.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:20.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:20.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:20.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:20.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:21.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:21.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:21.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:21.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:22.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:22.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:22.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:22.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:23.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:23.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:23.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:23.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:24.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:24.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:24.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:24.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:25.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:25.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:25.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:25.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:26.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:26.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:26.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:26.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:27.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:27.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:27.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:27.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:28.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:28.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:28.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:28.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:29.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:29.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:29.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:29.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:30.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:30.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:30.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:30.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:31.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:31.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:31.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:31.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:32.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:32.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:32.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:32.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:33.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:33.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:33.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:33.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:34.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:34.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:34.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:34.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:35.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:34.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:35.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:35.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:35.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:35.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:36.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:36.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:37.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:36.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:37.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:37.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:38.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:38.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:38.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:38.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:39.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:39.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:39.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:39.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:40.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:39.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:40.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:40.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:40.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:40.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:41.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:41.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:41.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:41.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 91 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:42.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:42.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:42.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:42.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:43.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:43.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:43.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:43.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:44.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:44.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:44.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:44.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:45.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:45.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:45.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:45.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:46.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:46.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:46.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:46.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:47.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:47.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:47.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:47.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:48.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:48.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:48.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:48.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:49.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:49.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:49.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:49.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:50.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:50.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:50.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:50.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:51.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:51.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:51.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:51.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:52.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:52.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:52.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:52.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:53.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:53.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:53.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:53.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:54.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:54.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:54.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:54.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:55.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:55.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:55.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:55.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:56.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:56.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:56.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:56.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:57.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:57.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:57.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:57.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:58.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:58.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:58.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:58.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:59.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:31:59.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:31:59.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:31:59.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:00.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:00.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:00.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:00.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:01.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:01.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:01.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:01.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:02.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:02.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:02.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:02.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:03.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:03.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:03.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:03.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:04.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:04.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:04.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:04.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:05.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:05.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:05.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:05.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:06.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:06.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:06.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:06.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:07.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:07.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:07.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:07.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:08.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:08.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:08.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:08.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:09.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:09.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:09.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:09.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:10.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:10.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:10.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:10.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:11.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:11.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:11.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:11.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:12.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:12.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:12.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:12.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:13.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:13.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:13.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:13.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:14.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:14.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:14.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:14.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:15.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:15.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:15.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:15.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:16.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:16.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:16.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:16.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:17.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:17.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:17.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:17.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:18.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:18.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:18.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:18.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:19.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:19.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:19.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:19.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:20.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:20.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:20.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:20.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:21.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:21.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:21.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:21.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:22.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:22.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:22.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:22.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:23.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:23.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:23.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:23.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:24.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:24.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:24.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:24.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:25.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:25.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:25.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:25.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:26.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:26.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:26.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:26.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:27.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:27.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:27.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:27.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:28.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:28.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:28.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:28.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:29.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:29.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:29.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:29.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:30.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:30.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:30.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:30.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:31.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:31.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:31.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:31.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:32.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:32.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:32.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:32.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:33.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:33.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:33.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:33.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:34.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:34.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:34.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:34.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:35.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:35.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:35.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:35.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:36.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:36.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:36.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:36.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:37.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:37.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:37.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:37.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:38.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:38.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:38.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:38.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:39.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:39.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:39.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:39.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:40.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:40.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:40.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:40.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:41.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:41.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:41.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:41.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:42.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:42.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:42.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:42.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:43.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:43.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:43.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:43.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:44.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:44.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:44.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:44.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:45.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:45.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:45.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:45.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:46.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:46.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:46.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:46.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:47.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:47.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:47.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:47.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:48.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:48.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:48.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:48.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:49.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:49.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:49.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:49.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:50.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:50.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:50.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:50.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:51.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:51.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:51.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:51.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:52.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:52.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:52.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:52.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:53.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:53.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:53.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:53.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:54.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:54.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:54.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:54.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:55.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:55.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:55.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:55.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:56.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:56.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:56.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:56.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:57.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:57.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:57.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:57.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:58.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:58.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:58.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:58.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:59.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:32:59.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:32:59.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:32:59.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:00.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:00.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:00.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:00.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:01.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:01.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:01.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:01.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:02.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:02.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:02.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:02.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:03.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:03.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:03.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:03.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:04.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:04.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:04.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:04.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:05.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:05.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:05.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:05.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:06.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:06.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:06.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:06.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:07.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:07.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:07.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:07.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:08.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:08.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:08.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:08.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:09.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:09.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:09.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:09.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:10.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:10.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:10.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:10.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:11.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:11.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:11.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:11.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:12.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:12.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:12.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:12.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:13.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:13.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:13.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:13.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:14.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:14.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:14.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:14.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:15.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:15.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:15.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:15.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:16.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:16.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:16.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:16.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:17.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:17.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:17.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:17.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:18.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:18.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:18.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:18.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:19.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:19.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:19.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:19.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:20.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:20.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:20.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:20.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:21.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:21.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:21.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:21.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:22.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:22.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:22.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:22.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:23.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:23.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:23.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:23.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:24.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:24.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:24.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:24.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:25.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:25.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:25.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:25.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:26.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:26.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:26.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:26.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:27.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:27.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:27.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:27.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:28.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:28.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:28.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:28.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:29.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:29.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:29.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:29.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:30.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:30.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:30.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:30.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:31.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:31.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:31.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:31.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:32.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:32.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:32.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:32.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:33.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:33.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:33.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:33.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:34.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:34.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:34.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:34.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:35.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:35.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:35.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:35.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:36.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:36.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:36.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:36.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:37.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:37.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:37.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:37.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:38.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:38.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:38.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:38.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:39.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:39.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:39.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:39.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:40.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:40.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:40.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:40.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:41.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:41.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:41.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:41.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:42.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:42.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:42.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:42.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:43.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:43.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:43.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:43.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:44.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:44.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:44.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:44.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:45.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:45.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:45.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:45.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:46.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:46.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:46.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:46.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:47.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:47.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:47.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:47.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:48.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:48.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:48.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:48.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:49.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:49.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:49.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:49.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:50.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:50.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:50.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:50.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:51.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:51.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:51.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:51.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:52.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:52.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:52.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:52.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:53.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:53.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:53.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:53.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:54.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:54.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:54.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:54.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:55.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:55.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:55.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:55.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:56.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:56.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:56.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:56.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:57.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:57.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:57.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:57.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:58.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:58.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:58.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:58.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:59.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:33:59.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:33:59.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:33:59.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:00.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:00.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:00.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:00.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:01.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:01.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:01.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:01.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:02.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:02.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:02.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:02.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:03.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:03.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:03.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:03.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:04.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:04.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:05.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:04.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:05.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:05.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:05.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:05.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:06.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:06.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:06.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:06.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:07.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:07.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:07.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:07.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:08.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:08.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:08.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:08.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:09.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:09.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:09.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:09.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:10.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:10.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:10.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:10.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:11.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:11.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:11.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:11.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:12.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:12.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:12.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:12.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:13.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:13.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:13.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:13.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:14.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:14.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:14.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:14.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:15.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:15.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:15.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:15.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:16.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:16.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:16.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:16.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:17.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:17.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:17.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:17.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:18.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:18.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:18.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:18.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:19.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:19.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:19.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:19.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:20.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:20.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:20.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:20.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:21.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:21.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:21.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:21.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:22.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:22.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:22.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:22.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:23.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:23.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:23.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:23.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:24.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:24.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:24.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:24.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:25.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:25.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:25.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:25.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:26.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:26.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:26.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:26.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:27.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:27.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:27.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:27.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:28.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:28.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:28.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:28.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:29.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:29.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:29.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:29.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:30.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:30.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:30.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:30.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:31.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:31.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:32.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:32.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:32.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:32.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:33.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:32.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:33.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:33.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:34.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:34.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:34.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:34.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:35.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:34.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:35.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:35.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:36.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:36.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:36.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:36.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:37.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:37.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:37.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:37.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:38.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:38.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:38.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:38.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:39.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:39.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:39.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:39.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:40.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:40.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:40.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:40.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:41.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:41.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:41.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:41.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:42.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:42.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:42.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:42.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:43.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:43.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:43.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:43.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:44.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:44.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:44.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:44.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:45.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:45.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:45.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:45.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:46.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:46.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:46.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:46.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:47.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:47.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:47.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:47.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:48.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:48.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:48.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:48.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:49.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:49.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:49.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:49.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:50.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:50.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:50.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:50.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:51.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:51.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:51.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:51.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:52.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:52.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:52.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:52.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:53.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:53.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:53.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:53.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:54.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:54.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:54.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:54.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:55.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:55.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:55.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:55.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:56.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:56.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:56.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:56.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:57.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:57.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:57.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:57.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:58.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:58.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:58.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:58.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:59.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:34:59.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:34:59.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:34:59.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:00.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:00.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:00.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:00.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:01.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:01.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:01.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:01.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:02.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:02.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:02.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:02.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:03.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:03.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:03.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:03.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:04.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:04.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:04.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:04.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:05.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:05.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:05.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:05.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:06.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:06.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:06.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:06.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:07.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:07.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:07.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:07.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:08.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:08.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:08.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:08.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:09.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:09.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:09.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:09.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:10.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:10.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:10.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:10.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:11.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:11.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:11.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:11.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:12.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:12.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:12.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:12.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:13.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:13.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:13.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:13.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:14.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:14.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:14.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:14.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:15.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:15.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:15.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:15.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:16.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:16.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:16.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:16.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:17.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:17.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:17.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:17.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:18.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:18.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:18.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:18.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:19.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:18.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:19.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:19.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:19.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:19.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:20.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:20.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:20.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:20.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:21.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:21.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:21.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:21.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:22.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:22.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:22.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:22.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:23.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:23.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:24.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:23.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:24.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:24.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:25.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:25.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:25.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:25.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:26.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:26.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:26.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:26.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:27.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:27.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:27.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:27.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:28.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:28.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:28.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:28.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:29.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:29.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:29.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:29.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:29.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:29.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:30.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:30.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:31.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:31.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:31.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:31.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:31.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:31.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:32.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:32.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:33.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:32.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:33.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:33.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:34.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:34.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:34.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:34.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:35.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:35.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:35.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:35.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:36.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:35.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:36.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:36.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:37.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:36.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:37.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:37.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:38.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:38.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:38.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:38.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:39.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:39.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:39.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:39.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:40.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:40.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:40.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:40.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:41.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:40.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:41.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:41.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:41.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:41.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:42.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:42.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:42.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:42.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:43.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:43.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:43.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:43.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:44.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:44.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:44.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:44.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:45.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:45.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:45.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:45.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:46.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:46.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:47.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:46.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:47.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:47.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:47.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:47.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:48.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:48.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:48.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:48.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:49.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:49.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:50.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:50.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:50.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:50.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:51.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:51.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:51.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:51.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:52.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:52.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:52.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:52.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:53.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:53.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:53.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:53.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:54.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:54.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:54.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:54.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:55.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:55.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:55.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:55.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:56.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:56.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:56.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:56.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:57.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:57.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:57.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:57.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:58.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:58.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:58.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:58.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:59.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:35:59.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:35:59.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:35:59.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:00.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:00.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:00.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:00.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:01.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:01.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:01.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:01.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:02.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:01.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:02.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:02.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:03.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:03.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:03.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:03.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:04.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:04.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:04.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:04.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:04.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:04.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:05.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:05.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:06.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:05.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:06.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:06.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:06.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:06.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:07.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:07.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:07.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:07.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:08.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:08.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:08.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:08.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:09.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:09.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:09.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:09.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:10.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:10.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:10.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:10.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:11.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:11.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:11.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:11.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:12.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:12.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:12.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:12.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:13.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:13.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:13.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:13.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:14.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:14.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:14.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:14.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:15.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:15.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:15.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:15.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:16.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:16.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:16.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:16.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:17.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:17.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:17.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:17.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:18.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:18.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:18.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:18.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:19.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:19.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:19.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:19.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:20.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:20.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:20.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:20.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:21.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:21.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:21.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:21.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:22.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:22.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:22.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:22.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:23.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:23.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:23.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:23.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:24.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:24.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:24.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:24.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:25.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:25.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:25.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:25.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:26.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:26.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:26.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:26.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:27.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:27.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:27.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:27.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:28.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:28.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:28.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:28.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:29.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:29.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:29.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:29.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:30.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:30.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:30.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:30.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:31.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:31.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:31.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:31.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:32.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:32.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:32.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:32.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:33.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:33.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:33.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:33.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:34.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:34.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:34.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:34.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:35.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:35.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:35.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:35.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:36.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:36.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:36.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:36.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:37.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:37.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:37.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:37.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:38.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:38.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:38.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:38.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:39.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:39.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:39.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:39.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:40.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:40.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:40.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:40.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:41.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:41.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:41.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:41.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:42.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:42.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:42.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:42.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:43.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:43.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:43.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:43.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:44.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:44.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:44.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:44.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:45.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:45.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:45.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:45.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:46.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:46.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:46.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:46.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:47.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:47.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:47.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:47.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:48.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:48.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:48.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:48.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:49.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:49.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:49.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:49.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:50.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:50.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:50.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:50.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:51.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:51.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:51.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:51.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:52.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:52.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:52.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:52.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:53.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:53.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:53.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:53.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:54.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:54.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:54.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:54.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:55.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:55.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:55.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:55.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:56.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:56.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:56.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:56.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:57.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:57.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:57.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:57.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:58.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:58.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:58.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:58.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:59.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:36:59.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:36:59.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:36:59.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:00.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:00.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:00.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:00.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:01.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:01.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:01.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:01.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:02.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:02.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:02.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:02.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:03.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:03.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:03.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:03.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:04.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:04.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:04.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:04.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:05.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:05.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:05.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:05.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:06.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:06.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:06.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:06.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:07.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:07.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:07.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:07.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:08.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:08.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:08.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:08.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:09.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:09.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:09.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:09.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:10.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:10.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:10.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:10.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:11.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:11.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:12.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:11.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:12.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:12.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:13.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:13.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:13.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:13.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:14.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:13.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:14.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:14.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:15.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:15.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:15.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:15.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:16.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:16.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:16.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:16.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:17.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:17.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:17.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:17.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:18.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:18.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:18.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:18.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:19.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:19.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:19.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:19.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:20.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:20.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:20.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:20.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:21.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:21.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:21.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:21.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:22.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:22.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:22.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:22.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:23.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:23.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:23.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:23.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:24.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:24.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:24.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:24.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:25.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:25.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:25.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:25.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:26.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:26.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:26.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:26.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:27.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:27.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:27.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:27.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:28.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:28.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:28.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:28.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:29.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:29.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:29.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:29.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:30.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:30.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:30.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:30.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:31.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:31.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:31.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:31.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:32.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:32.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:32.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:32.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:33.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:33.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:33.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:33.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:34.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:34.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:34.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:34.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:35.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:35.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:35.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:35.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:36.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:36.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:36.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:36.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:37.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:37.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:37.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:37.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:38.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:38.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:38.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:38.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:39.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:39.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:39.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:39.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:40.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:40.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:40.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:40.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:41.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:41.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:41.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:41.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:42.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:42.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:42.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:42.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:43.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:43.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:43.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:43.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:44.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:44.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:44.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:44.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:45.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:45.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:45.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:45.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:46.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:46.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:46.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:46.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:47.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:47.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:47.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:47.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:48.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:48.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:48.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:48.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:49.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:49.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:49.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:49.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:50.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:50.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:50.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:50.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:51.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:51.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:51.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:51.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:52.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:52.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:52.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:52.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:53.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:53.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:53.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:53.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:54.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:54.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:54.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:54.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:55.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:55.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:55.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:55.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:56.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:56.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:56.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:56.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:57.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:57.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:57.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:57.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:58.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:58.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:58.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:58.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:59.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:37:59.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:37:59.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:37:59.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:00.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:00.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:00.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:00.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:01.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:01.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:01.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:01.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:02.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:02.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:02.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:02.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:03.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:03.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:03.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:03.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:04.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:04.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:04.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:04.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:05.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:05.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:05.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:05.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:06.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:06.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:06.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:06.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:07.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:07.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:07.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:07.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:08.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:08.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:08.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:08.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:09.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:09.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:09.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:09.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:10.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:10.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:10.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:10.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:11.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:11.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:11.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:11.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:12.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:12.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:12.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:12.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:13.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:13.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:13.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:13.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:14.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:14.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:14.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:14.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:15.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:15.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:15.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:15.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:16.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:16.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:16.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:16.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:17.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:17.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:17.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:17.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:18.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:18.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:18.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:18.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:19.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:19.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:19.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:19.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:20.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:19.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:20.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:20.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:21.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:20.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:21.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:21.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:22.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:21.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:22.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:22.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:22.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:22.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:23.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:23.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:24.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:23.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:24.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:24.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:25.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:25.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:25.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:25.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:26.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:26.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:26.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:26.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:27.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:27.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:27.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:27.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:28.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:28.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:28.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:28.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:29.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:28.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:29.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:29.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:29.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:29.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:30.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:30.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:30.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:30.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:31.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:31.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:32.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:32.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:32.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:32.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:33.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:33.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:33.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:33.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:34.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:34.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:34.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:34.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:35.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:35.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:35.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:35.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:36.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:36.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:36.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:36.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:37.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:37.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:37.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:37.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:38.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:38.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:38.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:38.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:39.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:39.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:39.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:39.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:40.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:40.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:40.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:40.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:41.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:41.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:41.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:41.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:42.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:42.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:42.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:42.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:43.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:43.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:43.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:43.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:44.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:44.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:44.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:44.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:45.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:45.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:45.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:45.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:46.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:46.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:46.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:46.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:47.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:47.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:47.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:47.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:48.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:48.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:48.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:48.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:49.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:49.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:49.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:49.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:50.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:50.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:50.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:50.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:51.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:51.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:51.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:51.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:52.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:52.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:52.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:52.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:53.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:53.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:53.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:53.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:54.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:54.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:54.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:54.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:55.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:55.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:55.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:55.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:56.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:56.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:56.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:56.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:57.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:57.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:57.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:57.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:58.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:58.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:58.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:58.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:59.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:38:59.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:38:59.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:38:59.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:00.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:00.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:00.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:00.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:01.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:01.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:01.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:01.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:02.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:02.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:03.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:02.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:03.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:03.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:04.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:04.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:04.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:04.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:05.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:05.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:05.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:05.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:06.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:06.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:06.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:06.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:07.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:07.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:07.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:07.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:08.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:08.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:08.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:08.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:09.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:09.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:09.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:09.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:10.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:10.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:10.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:10.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:11.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:11.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:11.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:11.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:12.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:12.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:12.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:12.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:13.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:13.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:13.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:13.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:14.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:14.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:14.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:14.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:15.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:15.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:15.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:15.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:16.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:16.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:16.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:16.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:17.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:17.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:17.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:17.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:18.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:18.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:18.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:18.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:19.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:19.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:19.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:19.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:20.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:20.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:20.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:20.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:21.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:21.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:21.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:21.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:22.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:22.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:22.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:22.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:23.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:23.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:23.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:23.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:24.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:24.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:24.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:24.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:25.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:25.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:25.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:25.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:26.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:26.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:26.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:26.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:27.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:27.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:27.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:27.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:28.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:28.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:28.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:28.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:29.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:29.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:29.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:29.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:30.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:30.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:30.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:30.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:31.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:31.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:31.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:31.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:32.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:32.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:32.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:32.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:33.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:33.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:33.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:33.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:34.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:34.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:34.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:34.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:35.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:35.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:35.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:35.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:36.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:36.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:36.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:36.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:37.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:37.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:37.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:37.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:38.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:38.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:38.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:38.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:39.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:39.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:39.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:39.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:40.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:40.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:40.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:40.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:41.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:41.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:41.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:41.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:42.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:42.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:42.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:42.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:43.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:43.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:43.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:43.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:44.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:44.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:44.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:44.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:45.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:45.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:45.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:45.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:46.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:46.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:46.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:46.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:47.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:47.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:47.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:47.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:48.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:48.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:48.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:48.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:49.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:49.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:49.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:49.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:50.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:50.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:50.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:50.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:51.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:51.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:51.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:51.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:52.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:52.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:52.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:52.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:53.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:53.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:53.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:53.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:54.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:54.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:54.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:54.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:55.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:55.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:55.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:55.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:56.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:56.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:56.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:56.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:57.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:57.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:57.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:57.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:58.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:58.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:58.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:58.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:59.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:39:59.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:39:59.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:39:59.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:00.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:00.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:00.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:00.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:01.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:01.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:01.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:01.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:02.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:02.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:02.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:02.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:03.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:03.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:03.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:03.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:04.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:04.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:04.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:04.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:04.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:04.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:05.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:05.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:05.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:05.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:06.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:06.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:07.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:07.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:07.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:07.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:08.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:08.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:08.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:08.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:09.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:09.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:09.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:09.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:10.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:10.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:10.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:10.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:11.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:11.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:11.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:11.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:12.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:12.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:12.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:12.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:13.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:13.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:13.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:13.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:14.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:14.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:14.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:14.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:15.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:15.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:15.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:15.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:16.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:16.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:16.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:16.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:17.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:17.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:17.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:17.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:18.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:18.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:18.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:18.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:19.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:19.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:19.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:19.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:20.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:20.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:20.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:20.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:21.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:21.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:21.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:21.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:22.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:22.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:22.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:22.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:23.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:23.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:23.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:23.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:24.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:24.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:24.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:24.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:25.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:25.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:25.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:25.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:26.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:26.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:26.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:26.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:27.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:27.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:27.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:27.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:28.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:28.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:28.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:28.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:29.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:29.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:29.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:29.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:30.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:30.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:30.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:30.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:31.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:31.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:31.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:31.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:32.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:32.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:32.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:32.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:33.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:33.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:33.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:33.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:34.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:34.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:34.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:34.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:35.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:35.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:35.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:35.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:36.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:36.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:36.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:36.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:37.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:37.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:37.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:37.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:38.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:38.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:38.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:38.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:39.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:39.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:39.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:39.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:40.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:40.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:40.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:40.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:41.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:41.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:41.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:41.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:42.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:42.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:42.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:42.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:43.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:43.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:43.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:43.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:44.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:44.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:44.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:44.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:45.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:45.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:45.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:45.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:46.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:46.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:46.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:46.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:47.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:47.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:47.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:47.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:48.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:48.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:48.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:48.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:49.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:49.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:49.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:49.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:50.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:50.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:50.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:50.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:51.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:51.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:51.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:51.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:52.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:52.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:52.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:52.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:53.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:53.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:53.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:53.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:54.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:54.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:54.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:54.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:55.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:55.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:55.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:55.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:56.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:56.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:56.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:56.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:57.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:57.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:57.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:57.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:58.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:58.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:58.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:58.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:59.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:40:59.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:40:59.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:40:59.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:00.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:00.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:00.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:00.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:01.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:01.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:01.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:01.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:02.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:02.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:02.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:02.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:03.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:03.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:03.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:03.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:04.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:04.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:04.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:04.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:05.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:05.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:05.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:05.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:06.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:06.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:06.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:06.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:07.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:07.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:07.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:07.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:08.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:08.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:08.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:08.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:09.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:09.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:09.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:09.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:10.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:10.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:10.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:10.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:11.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:11.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:11.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:11.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:12.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:12.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:12.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:12.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:13.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:13.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:13.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:13.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:14.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:14.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:14.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:14.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:15.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:15.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:15.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:15.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:16.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:16.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:16.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:16.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:17.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:17.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:17.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:17.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:18.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:18.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:18.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:18.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:19.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:19.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:19.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:19.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:20.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:20.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:20.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:20.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:21.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:21.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:21.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:21.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:22.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:22.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:22.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:22.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:23.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:23.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:23.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:23.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:24.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:24.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:24.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:24.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:25.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:25.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:25.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:25.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:26.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:26.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:26.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:26.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:27.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:27.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:27.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:27.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:28.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:28.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:28.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:28.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:29.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:29.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:29.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:29.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:30.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:30.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:30.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:30.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:31.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:31.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:31.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:31.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:32.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:32.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:32.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:32.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:33.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:33.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:33.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:33.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:34.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:34.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:34.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:34.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:35.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:35.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:35.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:35.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:36.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:36.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:36.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:36.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:37.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:37.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:37.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:37.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:38.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:38.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:38.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:38.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:39.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:39.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:39.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:39.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:40.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:40.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:40.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:40.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:41.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:41.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:41.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:41.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:42.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:42.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:42.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:42.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:43.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:43.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:43.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:43.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:44.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:44.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:44.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:44.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:45.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:45.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:45.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:45.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:46.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:46.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:46.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:46.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:47.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:47.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:47.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:47.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:48.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:48.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:48.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:48.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:49.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:49.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:49.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:49.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:50.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:50.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:50.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:50.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:51.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:51.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:51.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:51.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:52.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:51.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:52.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:52.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:53.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:53.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:53.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:53.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:54.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:54.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:54.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:54.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:55.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:55.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:55.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:55.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:56.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:56.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:56.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:56.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:57.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:57.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:57.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:57.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:58.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:58.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:58.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:58.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:59.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:41:59.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:41:59.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:41:59.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:00.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:00.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:00.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:00.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:01.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:01.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:01.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:01.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:02.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:02.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:02.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:02.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:03.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:02.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:03.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:03.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:04.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:04.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:04.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:04.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:05.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:05.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:05.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:05.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:06.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:05.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:06.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:06.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:07.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:07.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:07.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:07.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:08.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:08.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:08.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:08.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:09.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:09.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:09.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:09.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:10.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:10.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:10.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:10.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:11.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:11.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:11.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:11.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:12.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:12.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:12.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:12.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:13.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:13.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:13.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:13.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:14.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:14.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:14.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:14.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:15.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:14.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:15.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:15.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:16.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:16.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:16.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:16.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:17.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:17.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:18.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:17.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:18.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:18.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:18.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:18.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:19.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:19.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:19.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:19.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:20.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:20.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:20.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:20.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:21.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:21.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:21.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:21.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:22.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:22.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:22.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:22.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:23.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:23.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:23.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:23.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:24.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:24.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:24.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:24.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:25.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:25.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:25.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:25.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:26.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:26.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:26.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:26.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:27.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:27.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:27.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:27.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:28.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:28.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:28.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:28.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:29.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:29.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:29.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:29.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:30.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:30.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:30.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:30.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:31.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:31.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:31.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:31.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:32.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:32.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:32.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:32.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:33.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:33.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:33.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:33.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:34.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:34.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:34.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:34.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:35.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:35.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:35.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:35.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:36.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:36.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:36.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:36.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:37.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:37.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:37.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:37.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:38.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:38.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:38.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:38.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:39.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:39.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:39.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:39.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:40.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:40.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:40.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:40.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:41.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:41.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:42.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:41.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:42.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:42.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:43.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:43.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:43.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:43.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:44.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:44.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:44.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:44.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:45.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:45.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:45.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:45.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:46.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:46.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:46.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:46.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:47.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:47.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:47.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:47.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:48.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:48.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:48.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:48.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:49.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:49.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:49.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:49.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:50.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:50.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:50.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:50.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:51.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:51.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:51.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:51.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:52.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:52.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:52.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:52.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:53.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:53.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:53.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:53.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:54.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:54.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:54.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:54.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:55.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:55.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:55.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:55.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:56.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:56.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:56.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:56.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:57.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:57.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:57.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:57.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:58.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:58.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:58.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:58.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:59.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:42:59.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:42:59.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:42:59.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:00.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:00.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:00.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:00.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:01.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:01.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:01.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:01.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:02.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:02.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:02.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:02.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:03.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:03.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:03.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:03.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:04.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:04.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:04.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:04.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:05.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:05.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:05.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:05.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:06.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:06.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:06.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:06.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:07.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:07.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:07.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:07.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:08.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:08.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:08.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:08.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:09.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:09.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:09.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:09.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:10.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:10.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:10.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:10.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:11.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:11.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:11.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:11.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:12.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:12.242+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:12.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:12.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:13.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:13.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:13.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:13.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:14.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:14.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:14.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:14.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:15.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:15.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:15.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:15.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:16.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:16.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:16.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:16.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:17.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:17.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:17.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:17.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:18.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:18.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:18.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:18.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:19.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:19.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:19.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:19.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:20.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:20.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:20.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:20.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:21.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:21.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:21.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:21.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:22.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:22.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:22.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:22.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:23.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:23.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:23.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:23.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:24.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:24.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:24.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:24.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:25.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:25.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:25.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:25.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:26.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:26.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:26.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:26.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:27.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:27.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:27.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:27.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:28.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:28.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:28.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:28.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:29.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:29.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:29.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:29.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:30.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:30.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:30.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:30.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:31.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:31.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:31.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:31.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:32.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:32.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:32.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:32.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:33.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:33.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:33.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:33.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:34.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:34.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:34.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:34.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:35.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:35.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:35.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:35.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:36.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:36.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:36.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:36.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:37.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:37.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:37.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:37.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:38.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:38.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:38.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:38.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:39.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:39.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:39.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:39.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:40.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:40.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:40.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:40.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:41.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:41.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:41.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:41.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:42.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:42.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:42.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:42.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:43.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:43.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:43.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:43.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:44.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:44.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:44.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:44.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:45.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:45.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:45.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:45.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:46.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:46.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:46.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:46.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:47.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:47.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:47.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:47.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:48.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:48.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:48.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:48.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:49.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:49.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:49.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:49.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:50.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:50.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:50.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:50.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:51.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:51.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:51.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:51.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:52.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:52.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:52.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:52.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:53.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:52.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:53.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:53.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:54.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:54.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:54.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:54.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:55.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:55.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:55.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:55.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:56.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:56.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:56.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:56.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:57.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:57.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:57.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:57.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:58.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:58.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:58.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:58.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:59.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:43:59.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:43:59.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:43:59.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:00.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:00.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:00.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:00.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:01.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:01.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:01.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:01.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:02.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:02.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:02.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:02.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:03.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:03.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:03.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:03.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:04.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:04.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:04.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:04.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:05.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:04.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:05.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:05.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:06.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:06.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:06.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:06.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:07.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:07.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:07.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:07.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:08.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:08.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:08.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:08.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:09.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:09.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:09.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:09.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:10.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:10.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:10.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:10.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:11.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:11.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:11.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:11.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:12.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:12.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:12.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:12.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:13.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:13.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:13.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:13.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:14.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:14.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:14.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:14.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:15.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:15.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:15.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:15.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:16.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:16.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:16.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:16.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:17.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:17.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:17.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:17.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:18.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:18.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:18.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:18.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:19.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:19.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:19.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:19.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:20.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:19.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:20.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:20.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:20.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:20.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:21.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:21.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:21.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:21.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:22.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:22.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:22.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:22.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:23.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:23.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:23.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:23.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:24.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:24.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:25.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:24.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:25.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:25.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:26.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:26.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:26.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:26.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:27.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:26.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:27.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:27.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:28.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:28.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:28.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:28.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:29.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:29.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:29.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:29.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:30.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:30.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:30.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:30.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:31.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:31.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:31.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:31.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:32.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:32.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:32.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:32.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:33.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:33.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:33.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:33.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:34.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:34.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:34.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:34.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:35.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:35.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:35.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:35.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:36.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:36.096+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:36.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:36.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:37.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:37.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:37.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:37.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:38.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:38.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:38.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:38.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:39.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:39.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:39.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:39.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:40.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:40.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:40.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:40.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:41.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:41.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:41.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:41.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:42.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:42.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:42.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:42.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:43.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:43.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:43.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:43.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:44.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:44.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:44.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:44.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:45.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:45.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:45.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:45.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:46.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:46.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:46.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:46.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:47.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:47.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:47.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:47.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:48.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:48.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:48.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:48.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:49.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:49.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:49.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:49.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:50.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:50.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:50.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:50.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:51.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:51.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:51.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:51.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:52.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:52.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:52.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:52.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:53.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:53.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:53.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:53.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:54.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:54.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:54.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:54.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:55.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:55.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:55.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:55.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:56.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:56.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:56.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:56.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:57.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:57.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:57.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:57.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:58.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:58.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:58.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:58.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:59.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:44:59.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:44:59.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:44:59.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:00.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:00.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:00.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:00.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:01.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:01.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:01.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:01.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:02.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:02.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:02.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:02.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:03.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:03.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:03.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:03.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:04.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:04.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:04.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:04.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:05.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:05.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:05.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:05.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:06.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:06.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:06.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:06.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:07.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:07.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:07.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:07.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:08.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:08.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:08.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:08.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:09.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:09.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:09.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:09.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:10.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:10.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:10.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:10.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:11.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:11.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:11.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:11.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:12.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:12.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:12.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:12.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:13.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:13.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:13.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:13.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:14.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:14.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:14.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:14.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:15.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:15.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:15.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:15.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:16.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:16.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:16.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:16.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:17.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:17.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:17.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:17.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:18.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:18.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:18.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:18.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:19.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:19.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:19.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:19.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:20.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:20.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:20.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:20.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:21.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:21.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:21.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:21.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:22.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:22.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:22.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:22.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:23.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:23.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:23.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:23.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:24.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:24.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:24.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:24.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:25.119 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:25.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:25.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:25.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:26.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:26.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:26.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:26.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:27.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:27.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:27.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:27.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:28.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:28.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:28.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:28.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:29.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:29.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:29.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:29.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:30.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:30.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:30.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:30.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:31.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:31.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:31.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:31.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:32.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:32.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:32.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:32.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:33.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:33.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:33.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:33.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:34.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:34.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:34.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:34.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:35.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:35.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:35.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:35.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:36.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:36.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:36.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:36.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:37.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:37.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:37.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:37.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:38.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:38.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:38.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:38.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:39.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:39.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:39.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:39.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:40.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:40.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:40.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:40.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:41.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:41.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:41.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:41.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:42.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:42.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:42.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:42.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:43.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:43.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:43.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:43.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:44.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:44.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:44.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:44.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:45.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:45.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:45.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:45.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:46.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:46.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:46.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:46.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:47.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:47.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:47.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:47.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:48.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:48.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:48.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:48.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:49.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:49.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:49.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:49.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:50.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:50.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:50.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:50.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:51.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:51.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:51.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:51.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:52.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:52.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:52.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:52.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:53.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:53.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:53.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:53.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:54.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:54.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:54.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:54.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:55.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:55.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:55.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:55.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:56.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:56.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:56.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:56.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:57.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:57.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:57.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:57.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:58.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:58.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:58.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:58.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:59.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:45:59.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:45:59.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:45:59.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:00.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:00.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:00.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:00.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:01.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:01.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:01.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:01.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:02.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:02.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:02.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:02.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:03.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:03.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:03.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:03.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:04.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:04.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:04.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:04.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:05.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:05.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:05.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:05.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:06.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:06.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:06.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:06.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:07.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:07.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:07.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:07.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:08.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:08.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:08.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:08.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:09.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:09.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:09.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:09.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:10.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:10.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:10.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:10.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:11.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:11.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:11.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:11.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 120 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:12.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:12.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:12.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:12.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:13.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:13.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:13.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:13.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:14.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:14.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:14.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:14.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:15.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:15.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:15.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:15.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:16.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:16.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:16.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:16.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:17.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:17.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:17.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:17.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:18.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:18.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:18.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:18.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:19.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:19.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:19.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:19.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:20.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:20.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:20.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:20.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:21.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:21.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:21.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:21.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:22.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:22.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:22.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:22.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:23.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:23.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:23.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:23.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:24.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:24.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:24.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:24.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:25.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:25.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:25.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:25.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:26.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:26.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:26.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:26.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:27.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:27.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:27.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:27.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:28.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:28.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:28.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:28.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:29.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:29.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:29.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:29.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:30.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:30.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:30.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:30.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:31.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:31.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:31.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:31.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:32.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:32.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:32.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:32.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:33.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:33.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:33.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:33.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:34.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:34.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:34.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:34.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:35.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:35.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:35.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:35.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:36.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:36.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:36.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:36.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:37.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:37.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:37.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:37.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:38.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:38.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:38.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:38.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:39.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:39.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:39.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:39.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:40.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:40.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:40.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:40.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:41.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:41.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:41.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:41.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 42 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T00:46:42.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:42.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:42.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:42.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:43.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:43.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:43.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:43.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:44.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:44.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:44.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:44.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:45.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:45.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:45.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:45.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:46.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:46.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:46.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:46.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:47.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:47.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:47.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:47.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:48.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:48.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:48.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:48.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:49.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:49.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:49.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:49.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:50.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:50.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:50.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:50.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:51.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:51.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:51.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:51.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:52.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:52.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:52.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:52.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:53.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:53.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:53.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:53.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:54.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:54.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:54.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:54.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:55.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:55.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:55.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:55.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:56.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:56.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:56.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:56.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:57.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:57.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:57.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:57.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:58.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:58.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:58.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:58.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:59.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:46:59.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:46:59.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:46:59.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:00.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:00.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:00.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:00.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:01.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:01.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:01.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:01.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:02.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:02.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:02.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:02.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:03.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:03.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:03.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:03.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:04.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:04.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:04.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:04.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:05.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:05.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:05.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:05.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:06.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:06.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:06.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:06.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:07.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:07.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:07.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:07.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:08.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:08.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:08.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:08.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:09.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:09.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:09.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:09.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:10.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:10.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:10.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:10.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:11.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:11.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:11.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:11.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:12.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:12.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:12.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:12.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:13.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:13.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:13.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:13.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:14.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:14.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:14.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:14.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:15.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:15.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:15.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:15.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:16.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:16.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:16.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:16.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:17.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:17.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:17.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:17.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:18.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:18.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:18.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:18.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:19.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:19.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:19.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:19.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:20.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:20.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:20.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:20.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:21.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:21.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:21.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:21.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:22.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:22.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:22.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:22.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:23.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:23.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:23.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:23.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:24.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:24.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:24.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:24.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:25.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:25.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:25.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:25.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:26.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:26.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:26.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:26.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:27.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:27.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:27.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:27.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:28.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:28.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:28.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:28.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:29.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:29.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:29.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:29.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:30.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:30.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:30.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:30.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:31.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:31.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:31.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:31.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:32.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:32.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:32.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:32.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:33.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:33.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:33.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:33.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:34.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:34.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:34.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:34.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:35.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:35.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:35.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:35.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:36.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:36.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:36.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:36.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:37.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:37.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:37.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:37.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:38.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:38.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:38.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:38.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:39.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:39.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:39.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:39.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:40.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:40.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:40.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:40.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:41.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:41.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:41.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:41.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:42.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:42.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:42.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:42.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:43.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:43.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:43.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:43.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:44.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:44.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:44.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:44.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:45.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:45.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:45.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:45.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:46.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:46.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:46.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:46.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:47.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:47.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:47.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:47.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:48.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:48.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:48.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:48.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:49.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:49.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:49.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:49.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:50.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:50.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:50.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:50.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:51.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:51.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:51.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:51.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:52.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:52.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:52.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:52.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:53.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:53.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:53.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:53.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:54.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:54.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:54.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:54.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:55.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:55.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:55.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:55.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:56.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:56.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:56.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:56.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:57.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:57.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:57.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:57.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:58.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:58.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:58.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:58.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:59.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:47:59.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:47:59.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:47:59.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:00.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:00.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:00.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:00.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:01.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:01.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:01.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:01.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:02.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:02.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:02.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:02.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:03.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:03.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:03.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:03.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:04.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:04.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:04.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:04.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:05.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:05.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:05.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:05.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:06.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:06.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:06.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:06.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:07.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:07.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:07.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:07.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:08.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:08.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:08.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:08.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:09.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:09.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:09.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:09.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:10.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:10.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:10.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:10.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:11.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:11.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:11.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:11.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:12.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:12.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:12.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:12.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:13.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:13.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:13.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:13.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:14.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:14.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:14.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:14.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:15.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:15.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:15.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:15.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:16.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:16.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:16.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:16.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:17.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:17.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:17.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:17.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:18.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:18.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:18.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:18.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:19.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:19.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:19.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:19.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:20.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:20.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:20.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:20.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:21.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:21.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:21.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:21.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:22.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:22.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:22.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:22.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:23.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:23.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:23.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:23.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:24.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:24.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:24.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:24.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:25.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:25.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:25.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:25.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:26.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:26.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:26.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:26.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:27.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:27.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:27.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:27.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:28.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:28.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:28.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:28.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:29.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:29.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:29.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:29.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:30.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:30.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:30.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:30.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:31.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:31.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:31.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:31.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:32.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:32.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:32.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:32.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:33.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:33.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:33.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:33.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:34.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:34.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:34.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:34.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:35.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:35.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:35.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:35.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:36.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:36.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:36.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:36.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:37.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:37.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:37.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:37.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:38.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:38.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:38.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:38.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:39.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:39.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:39.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:39.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:40.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:40.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:40.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:40.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:41.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:41.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:41.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:41.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:42.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:42.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:42.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:42.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:43.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:43.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:43.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:43.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:44.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:44.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:44.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:44.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:45.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:45.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:45.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:45.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:46.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:46.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:46.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:46.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:47.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:47.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:47.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:47.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:48.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:48.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:48.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:48.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:49.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:49.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:49.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:49.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:50.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:50.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:50.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:50.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:51.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:51.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:51.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:51.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:52.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:52.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:52.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:52.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:53.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:53.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:53.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:53.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:54.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:54.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:54.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:54.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:55.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:55.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:55.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:55.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:56.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:56.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:56.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:56.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:57.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:57.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:57.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:57.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:58.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:58.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:58.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:58.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:59.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:48:59.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:48:59.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:48:59.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:00.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:00.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:00.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:00.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:01.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:01.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:01.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:01.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:02.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:02.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:02.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:02.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:03.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:03.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:03.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:03.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:04.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:04.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:04.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:04.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:05.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:05.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:05.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:05.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:06.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:06.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:06.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:06.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:07.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:07.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:07.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:07.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:08.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:08.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:08.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:08.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:09.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:09.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:09.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:09.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:10.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:10.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:10.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:10.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:11.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:11.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:11.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:11.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:12.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:12.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:12.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:12.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:13.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:13.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:13.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:13.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:14.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:14.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:14.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:14.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:15.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:15.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:15.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:15.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:16.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:16.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:16.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:16.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:17.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:17.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:17.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:17.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:18.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:18.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:18.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:18.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:19.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:19.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:19.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:19.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:20.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:20.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:20.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:20.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:21.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:21.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:21.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:21.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:22.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:22.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:22.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:22.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:23.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:23.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:23.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:23.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:24.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:24.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:24.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:24.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:25.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:25.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:25.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:25.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:26.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:26.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:26.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:26.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:27.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:27.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:27.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:27.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:28.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:28.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:28.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:28.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:29.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:29.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:29.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:29.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:30.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:30.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:30.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:30.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:31.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:31.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:31.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:31.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:32.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:32.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:32.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:32.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:33.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:33.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:33.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:33.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:34.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:34.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:34.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:34.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:35.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:35.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:35.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:35.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:36.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:36.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:36.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:36.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:37.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:37.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:37.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:37.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:38.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:38.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:38.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:38.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:39.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:39.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:39.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:39.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:40.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:40.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:40.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:40.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:41.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:41.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:41.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:41.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:42.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:42.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:42.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:42.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:43.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:43.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:43.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:43.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:44.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:44.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:44.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:44.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:45.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:45.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:45.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:45.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:46.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:46.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:46.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:46.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:47.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:47.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:47.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:47.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:48.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:48.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:48.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:48.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:49.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:49.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:49.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:49.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:50.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:50.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:50.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:50.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:51.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:51.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:51.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:51.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:52.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:52.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:52.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:52.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:53.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:53.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:53.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:53.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:54.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:54.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:54.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:54.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:55.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:55.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:55.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:55.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:56.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:56.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:56.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:56.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:57.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:57.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:57.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:57.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:58.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:58.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:58.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:58.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:59.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:49:59.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:49:59.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:49:59.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:00.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:00.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:00.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:00.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:01.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:01.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:01.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:01.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:02.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:02.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:02.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:02.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:03.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:03.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:03.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:03.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:04.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:04.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:04.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:04.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:05.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:05.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:05.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:05.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:06.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:06.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:06.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:06.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:07.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:07.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:07.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:07.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:08.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:08.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:08.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:08.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:09.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:09.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:09.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:09.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:10.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:10.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:10.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:10.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:11.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:11.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:11.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:11.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:12.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:12.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:12.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:12.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:13.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:13.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:13.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:13.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:14.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:14.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:14.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:14.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:15.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:15.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:15.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:15.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:16.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:16.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:16.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:16.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:17.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:17.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:17.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:17.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:18.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:18.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:18.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:18.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:19.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:19.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:19.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:19.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:20.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:20.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:20.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:20.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:21.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:21.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:21.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:21.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:22.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:22.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:22.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:22.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:23.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:23.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:23.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:23.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:24.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:24.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:24.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:24.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:25.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:25.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:25.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:25.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:26.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:26.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:26.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:26.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:27.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:27.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:27.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:27.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:28.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:28.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:28.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:28.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:29.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:29.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:29.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:29.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:30.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:30.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:30.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:30.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:31.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:31.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:31.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:31.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:32.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:32.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:32.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:32.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:33.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:33.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:33.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:33.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:34.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:34.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:34.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:34.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:35.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:35.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:35.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:35.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:36.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:36.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:36.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:36.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:37.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:37.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:37.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:37.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:38.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:38.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:38.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:38.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:39.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:39.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:39.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:39.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:40.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:40.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:40.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:40.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:41.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:41.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:41.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:41.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:42.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:42.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:42.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:42.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:43.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:43.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:43.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:43.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:44.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:44.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:44.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:44.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:45.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:45.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:45.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:45.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:46.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:46.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:46.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:46.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:47.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:47.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:47.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:47.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:48.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:48.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:48.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:48.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:49.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:49.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:49.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:49.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:50.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:50.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:50.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:50.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:51.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:51.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:51.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:51.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:52.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:52.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:52.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:52.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:53.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:53.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:53.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:53.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:54.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:54.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:54.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:54.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:55.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:55.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:55.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:55.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:56.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:56.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:56.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:56.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:57.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:57.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:57.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:57.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:58.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:58.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:58.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:58.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:59.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:50:59.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:50:59.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:50:59.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:00.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:00.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:00.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:00.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:01.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:01.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:01.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:01.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:02.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:02.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:02.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:02.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:03.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:03.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:03.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:03.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:04.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:04.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:04.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:04.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:05.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:05.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:05.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:05.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:06.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:06.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:06.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:06.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:07.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:07.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:07.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:07.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:08.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:08.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:08.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:08.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:09.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:09.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:09.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:09.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:10.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:10.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:10.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:10.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:11.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:11.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:11.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:11.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:12.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:12.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:12.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:12.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:13.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:13.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:13.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:13.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:14.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:14.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:14.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:14.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:15.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:15.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:15.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:15.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:16.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:16.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:16.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:16.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:17.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:17.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:17.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:17.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:18.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:18.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:18.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:18.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:19.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:19.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:19.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:19.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:20.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:20.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:20.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:20.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:21.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:21.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:21.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:21.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:22.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:22.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:22.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:22.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:23.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:23.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:23.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:23.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:24.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:24.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:24.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:24.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:25.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:25.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:25.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:25.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:26.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:26.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:26.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:26.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:27.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:27.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:27.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:27.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:28.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:28.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:28.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:28.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:29.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:29.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:29.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:29.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:30.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:30.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:30.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:30.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:31.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:31.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:31.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:31.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:32.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:32.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:32.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:32.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:33.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:33.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:33.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:33.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:34.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:34.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:34.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:34.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:35.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:35.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:35.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:35.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:36.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:36.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:36.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:36.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:37.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:37.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:37.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:37.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:38.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:38.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:38.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:38.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:39.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:39.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:39.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:39.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:40.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:40.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:40.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:40.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:41.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:41.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:41.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:41.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:42.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:42.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:42.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:42.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:43.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:43.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:43.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:43.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:44.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:44.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:44.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:44.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:45.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:45.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:45.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:45.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:46.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:46.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:46.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:46.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:47.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:47.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:47.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:47.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:48.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:48.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:48.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:48.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:49.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:49.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:49.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:49.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:50.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:50.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:50.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:50.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:51.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:51.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:51.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:51.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:52.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:52.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:52.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:52.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:53.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:53.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:53.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:53.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:54.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:54.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:54.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:54.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:55.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:55.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:55.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:55.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:56.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:56.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:56.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:56.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:57.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:57.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:57.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:57.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:58.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:58.503+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:58.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:58.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:59.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:51:59.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:51:59.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:51:59.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:00.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:00.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:00.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:00.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:01.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:01.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:01.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:01.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:02.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:02.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:02.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:02.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:03.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:03.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:03.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:03.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:04.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:04.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:04.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:04.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:05.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:05.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:05.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:05.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:06.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:06.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:06.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:06.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:07.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:07.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:07.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:07.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:08.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:08.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:08.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:08.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:09.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:09.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:09.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:09.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:10.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:10.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:10.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:10.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:11.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:11.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:11.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:11.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:12.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:12.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:12.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:12.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:13.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:13.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:13.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:13.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:14.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:14.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:14.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:14.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:15.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:15.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:15.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:15.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:16.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:16.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:16.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:16.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:17.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:17.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:17.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:17.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:18.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:18.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:18.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:18.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:19.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:19.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:19.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:19.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:20.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:20.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:20.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:20.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:21.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:21.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:21.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:21.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:22.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:22.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:22.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:22.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:23.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:23.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:23.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:23.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:24.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:24.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:24.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:24.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:25.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:25.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:25.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:25.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:26.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:26.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:26.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:26.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:27.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:27.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:27.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:27.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:28.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:28.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:28.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:28.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:29.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:29.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:29.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:29.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:30.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:30.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:30.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:30.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:31.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:31.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:31.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:31.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:32.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:32.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:32.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:32.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:33.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:33.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:33.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:33.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:34.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:34.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:34.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:34.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:35.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:35.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:35.781 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:35.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:36.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:36.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:36.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:36.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:37.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:37.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:37.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:37.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:38.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:38.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:38.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:38.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:39.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:39.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:39.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:39.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:40.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:40.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:40.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:40.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:41.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:41.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:41.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:41.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:42.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:42.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:42.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:42.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:43.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:43.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:43.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:43.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:44.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:44.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:44.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:44.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:45.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:45.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:45.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:45.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:46.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:46.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:46.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:46.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:47.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:47.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:47.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:47.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:48.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:48.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:48.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:48.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:49.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:49.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:49.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:49.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:50.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:50.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:50.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:50.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:51.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:51.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:51.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:51.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:52.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:52.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:52.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:52.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:53.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:53.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:53.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:53.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:54.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:54.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:54.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:54.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:55.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:55.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:55.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:55.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:56.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:56.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:56.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:56.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:57.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:57.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:57.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:57.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:58.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:58.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:58.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:58.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:59.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:52:59.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:52:59.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:52:59.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:00.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:00.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:00.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:00.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:01.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:01.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:01.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:01.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:02.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:02.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:02.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:02.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:03.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:03.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:03.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:03.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:04.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:04.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:04.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:04.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:05.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:05.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:05.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:05.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:06.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:06.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:06.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:06.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:07.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:07.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:07.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:07.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:08.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:08.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:08.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:08.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:09.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:09.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:09.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:09.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:10.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:10.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:10.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:10.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:11.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:11.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:11.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:11.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:12.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:12.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:12.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:12.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:13.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:13.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:13.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:13.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:14.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:14.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:14.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:14.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:15.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:15.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:15.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:15.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:16.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:16.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:16.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:16.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:17.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:17.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:17.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:17.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:18.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:18.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:18.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:18.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:19.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:19.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:19.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:19.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:20.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:20.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:20.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:20.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:21.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:21.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:21.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:21.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:22.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:22.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:22.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:22.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:23.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:23.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:23.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:23.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:24.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:24.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:24.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:24.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:25.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:25.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:25.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:25.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:26.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:26.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:26.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:26.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:27.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:27.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:27.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:27.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:28.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:28.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:28.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:28.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:29.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:29.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:29.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:29.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:30.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:30.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:30.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:30.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:31.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:31.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:31.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:31.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:32.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:32.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:32.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:32.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:33.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:33.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:33.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:33.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:34.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:34.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:34.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:34.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:35.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:35.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:35.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:35.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:36.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:36.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:36.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:36.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:37.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:37.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:37.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:37.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:38.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:38.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:38.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:38.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:39.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:39.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:39.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:39.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:40.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:40.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:40.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:40.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:41.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:41.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:41.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:41.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:42.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:42.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:42.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:42.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:43.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:43.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:43.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:43.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:44.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:44.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:45.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:44.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:45.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:45.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:45.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:45.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:46.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:46.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:46.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:46.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:47.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:47.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:47.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:47.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:48.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:48.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:48.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:48.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:49.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:49.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:49.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:49.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:50.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:50.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:50.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:50.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:51.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:51.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:51.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:51.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:52.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:52.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:53.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:52.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:53.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:53.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:54.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:53.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:54.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:54.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:55.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:55.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:55.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:55.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:55.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:55.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:56.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:56.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:56.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:56.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:57.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:57.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:57.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:57.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:58.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:58.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:58.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:58.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:59.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:53:59.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:53:59.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:53:59.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:00.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:00.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:00.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:00.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:01.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:01.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:01.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:01.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:02.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:02.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:02.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:02.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:03.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:03.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:03.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:03.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:04.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:04.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:04.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:04.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:05.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:05.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:05.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:05.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:06.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:06.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:06.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:06.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:07.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:07.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:07.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:07.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:08.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:08.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:08.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:08.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:09.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:09.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:09.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:09.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:10.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:10.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:10.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:10.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:11.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:11.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:11.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:11.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:12.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:12.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:12.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:12.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:13.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:13.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:13.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:13.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:14.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:14.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:14.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:14.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:15.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:15.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:16.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:16.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:16.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:16.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:17.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:16.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:17.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:17.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:18.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:18.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:18.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:18.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:18.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:18.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:19.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:19.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:20.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:19.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:20.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:20.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:21.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:21.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:21.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:21.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:22.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:22.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:22.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:22.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:23.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:23.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:23.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:23.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:24.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:24.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:24.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:24.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:25.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:25.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:25.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:25.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:26.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:26.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:26.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:26.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:27.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:27.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:27.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:27.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:28.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:28.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:28.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:28.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:29.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:29.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:29.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:29.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:30.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:30.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:30.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:30.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:31.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:31.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:31.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:31.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:32.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:32.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:32.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:32.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:33.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:33.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:33.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:33.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:34.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:34.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:34.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:34.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:35.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:35.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:35.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:35.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:36.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:36.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:36.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:36.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:36.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:36.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:37.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:37.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:37.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:37.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:38.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:38.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:38.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:38.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:39.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:39.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:39.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:39.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:40.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:40.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:40.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:40.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:41.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:41.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:41.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:41.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:42.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:42.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:42.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:42.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:43.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:43.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:43.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:43.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:44.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:44.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:44.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:44.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:45.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:45.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:45.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:45.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:46.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:46.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:46.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:46.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:47.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:47.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:47.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:47.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:48.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:48.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:48.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:48.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:49.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:49.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:49.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:49.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:50.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:50.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:50.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:50.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:51.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:51.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:51.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:51.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:52.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:52.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:52.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:52.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:53.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:53.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:53.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:53.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:54.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:54.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:54.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:54.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:55.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:55.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:55.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:55.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:56.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:56.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:56.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:56.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:57.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:57.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:57.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:57.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:58.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:58.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:58.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:58.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:59.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:54:59.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:54:59.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:54:59.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:00.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:00.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:00.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:00.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:01.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:01.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:01.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:01.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:02.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:02.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:02.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:02.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:03.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:03.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:03.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:03.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:04.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:04.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:04.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:04.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:05.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:05.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:05.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:05.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:06.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:06.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:06.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:06.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:07.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:07.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:07.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:07.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:08.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:08.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:08.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:08.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:09.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:09.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:09.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:09.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:10.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:10.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:10.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:10.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:11.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:11.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:11.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:11.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:12.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:12.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:12.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:12.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:13.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:13.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:13.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:13.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:14.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:14.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:14.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:14.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:15.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:15.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:16.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:16.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:16.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:16.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:17.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:17.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:17.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:17.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:18.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:18.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:18.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:18.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:19.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:19.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:19.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:19.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:20.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:20.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:20.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:20.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:21.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:21.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:21.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:21.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:22.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:21.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:22.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:22.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:22.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:22.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:23.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:23.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:23.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:23.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:24.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:24.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:24.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:24.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:25.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:25.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:25.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:25.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:26.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:26.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:26.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:26.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:27.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:27.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:27.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:27.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:28.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:28.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:28.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:28.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:29.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:29.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:29.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:29.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:30.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:30.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:30.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:30.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:31.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:31.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:31.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:31.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:32.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:32.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:32.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:32.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:33.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:33.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:33.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:33.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:34.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:34.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:34.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:34.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:35.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:35.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:35.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:35.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:36.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:36.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:36.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:36.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:37.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:37.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:37.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:37.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:38.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:38.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:38.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:38.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:39.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:39.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:39.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:39.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:40.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:40.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:40.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:40.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:41.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:41.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:41.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:41.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:42.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:42.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:42.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:42.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:43.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:43.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:43.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:43.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:44.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:44.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:44.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:44.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:45.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:45.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:45.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:45.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:46.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:46.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:46.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:46.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:47.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:47.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:47.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:47.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:48.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:48.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:48.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:48.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:49.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:49.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:49.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:49.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:50.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:50.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:50.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:50.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:51.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:51.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:51.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:51.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:52.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:52.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:52.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:52.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:53.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:53.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:53.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:53.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:54.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:54.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:54.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:54.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:55.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:55.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:55.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:55.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:56.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:56.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:56.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:56.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:57.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:57.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:57.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:57.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:58.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:58.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:58.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:58.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:59.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:55:59.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:55:59.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:55:59.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:00.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:00.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:00.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:00.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:01.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:01.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:01.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:01.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:02.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:02.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:02.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:02.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:03.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:03.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:03.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:03.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:04.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:04.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:04.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:04.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:05.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:05.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:05.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:05.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:06.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:06.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:06.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:06.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:07.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:07.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:07.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:07.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:08.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:08.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:08.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:08.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:09.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:09.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:10.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:09.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:10.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:10.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:11.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:11.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:11.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:11.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:12.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:12.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:12.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:12.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:13.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:13.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:13.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:13.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:14.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:14.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:14.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:14.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:15.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:15.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:15.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:15.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:16.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:16.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:16.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:16.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:17.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:17.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:17.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:17.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:18.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:18.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:18.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:18.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:19.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:19.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:19.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:19.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:20.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:20.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:20.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:20.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:21.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:21.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:21.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:21.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:22.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:22.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:22.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:22.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:23.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:23.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:23.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:23.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:24.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:24.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:24.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:24.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:25.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:25.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:25.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:25.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:26.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:26.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:26.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:26.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:26.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:26.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:27.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:27.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:27.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:27.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:28.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:28.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:29.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:29.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:29.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:29.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:29.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:29.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:30.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:30.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:30.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:30.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:31.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:31.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:32.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:32.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:32.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:32.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:33.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:33.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:33.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:33.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:34.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:34.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:34.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:34.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:35.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:35.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:35.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:35.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:36.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:36.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:36.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:36.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:37.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:37.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:37.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:37.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:38.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:38.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:38.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:38.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:39.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:39.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:39.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:39.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:40.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:40.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:40.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:40.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:41.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:41.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:41.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:41.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:42.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:42.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:42.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:42.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:43.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:43.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:43.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:43.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:44.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:44.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:44.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:44.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:45.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:45.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:45.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:45.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:46.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:46.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:46.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:46.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:47.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:47.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:47.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:47.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:48.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:48.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:48.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:48.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:49.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:49.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:49.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:49.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:50.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:50.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:50.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:50.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:51.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:51.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:51.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:51.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:52.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:52.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:52.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:52.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:53.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:53.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:53.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:53.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:54.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:54.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:54.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:54.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:55.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:55.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:55.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:55.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:56.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:56.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:56.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:56.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:57.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:57.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:57.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:57.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:58.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:58.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:58.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:58.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:59.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:56:59.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:56:59.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:56:59.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:00.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:00.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:00.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:00.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:01.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:01.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:01.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:01.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:02.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:02.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:02.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:02.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:03.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:03.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:03.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:03.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:04.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:04.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:04.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:04.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:05.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:05.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:05.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:05.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:06.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:06.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:06.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:06.185+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:07.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:07.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:07.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:07.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:08.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:08.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:08.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:08.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:09.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:09.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:09.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:09.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:10.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:10.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:10.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:10.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:11.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:11.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:11.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:11.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:12.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:12.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:12.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:12.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:13.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:13.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:13.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:13.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:14.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:14.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:14.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:14.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:15.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:15.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:15.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:15.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:16.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:16.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:16.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:16.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:17.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:17.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:17.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:17.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:18.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:18.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:18.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:18.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:19.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:19.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:19.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:19.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:20.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:20.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:20.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:20.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:21.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:21.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:21.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:21.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:22.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:22.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:22.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:22.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:23.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:23.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:23.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:23.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:24.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:24.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:24.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:24.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:25.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:25.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:25.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:25.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:26.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:26.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:26.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:26.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:27.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:27.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:27.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:27.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:28.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:28.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:28.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:28.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:29.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:29.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:29.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:29.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:30.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:30.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:30.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:30.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:31.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:31.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:31.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:31.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:32.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:32.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:32.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:32.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:33.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:33.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:33.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:33.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:34.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:34.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:34.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:34.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:35.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:35.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:35.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:35.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:36.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:36.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:36.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:36.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:37.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:37.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:37.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:37.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:38.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:38.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:38.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:38.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:39.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:39.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:39.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:39.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:40.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:40.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:40.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:40.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:41.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:41.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:41.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:41.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:42.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:42.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:42.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:42.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:43.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:43.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:43.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:43.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:44.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:44.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:44.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:44.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:45.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:45.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:45.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:45.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:46.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:46.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:46.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:46.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:47.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:47.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:47.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:47.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:48.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:48.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:48.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:48.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:49.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:49.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:49.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:49.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:50.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:50.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:50.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:50.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:51.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:51.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:51.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:51.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:52.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:52.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:52.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:52.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:53.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:53.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:53.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:53.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:54.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:54.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:54.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:54.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:55.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:55.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:55.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:55.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:56.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:56.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:56.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:56.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:57.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:57.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:57.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:57.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:58.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:58.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:58.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:58.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:59.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:57:59.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:57:59.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:57:59.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:00.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:00.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:00.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:00.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:01.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:01.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:01.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:01.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:02.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:02.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:02.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:02.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:03.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:03.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:03.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:03.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:04.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:04.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:04.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:04.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:05.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:05.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:05.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:05.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:06.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:06.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:06.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:06.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:07.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:07.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:07.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:07.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:08.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:08.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:08.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:08.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:09.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:09.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:09.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:09.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:10.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:10.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:10.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:10.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:11.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:11.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:11.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:11.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:11.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:11.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:12.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:12.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:13.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:13.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:13.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:13.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:14.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:14.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:14.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:14.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:15.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:15.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:15.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:15.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:16.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:16.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:16.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:16.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:17.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:17.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:17.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:17.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:18.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:18.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:18.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:18.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:19.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:19.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:19.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:19.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:20.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:20.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:20.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:20.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:21.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:21.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:21.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:21.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:22.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:22.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:22.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:22.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:23.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:23.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:23.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:23.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:24.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:24.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:24.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:24.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:25.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:25.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:25.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:25.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:26.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:26.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:26.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:26.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:27.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:27.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:27.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:27.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:27.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:27.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:28.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:28.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:29.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:29.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:29.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:29.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:30.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:30.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:30.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:30.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:31.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:31.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:31.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:31.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:32.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:32.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:32.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:32.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:33.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:33.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:33.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:33.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:34.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:34.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:34.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:34.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:34.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:34.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:35.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:35.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:35.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:35.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:36.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:36.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:36.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:36.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:37.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:37.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:37.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:37.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:38.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:38.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:38.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:38.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:39.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:39.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:39.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:39.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:40.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:40.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:40.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:40.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:41.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:41.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:41.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:41.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:42.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:42.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:42.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:42.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:43.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:43.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:43.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:43.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:44.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:44.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:44.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:44.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:45.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:45.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:45.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:45.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:46.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:46.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:46.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:46.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:47.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:47.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:47.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:47.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:48.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:48.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:48.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:48.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:49.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:49.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:49.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:49.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:50.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:50.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:50.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:50.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:51.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:51.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:51.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:51.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:52.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:52.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:52.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:52.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:53.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:53.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:53.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:53.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:54.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:54.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:54.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:54.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:55.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:55.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:55.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:55.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:56.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:56.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:56.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:56.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:57.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:57.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:57.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:57.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:58.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:58.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:58.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:58.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:59.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:58:59.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:58:59.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:58:59.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:00.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:00.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:00.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:00.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:01.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:01.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:01.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:01.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:02.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:02.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:02.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:02.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:03.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:03.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:03.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:03.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:04.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:04.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:04.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:04.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:05.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:05.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:05.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:05.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:06.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:06.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:06.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:06.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:07.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:07.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:07.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:07.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:08.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:08.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:08.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:08.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:09.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:09.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:09.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:09.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:10.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:10.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:10.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:10.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:11.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:11.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:11.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:11.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:12.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:12.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:12.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:12.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:13.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:13.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:13.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:13.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:14.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:14.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:14.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:14.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:15.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:15.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:15.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:15.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:16.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:16.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:16.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:16.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:17.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:17.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:17.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:17.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:18.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:18.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:18.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:18.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:19.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:19.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:19.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:19.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:20.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:20.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:20.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:20.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:21.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:21.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:21.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:21.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:22.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:22.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:22.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:22.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:23.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:23.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:23.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:23.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:24.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:24.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:24.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:24.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:25.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:25.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:25.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:25.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:26.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:26.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:26.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:26.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:27.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:27.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:27.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:27.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:28.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:28.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:28.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:28.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:29.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:29.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:29.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:29.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:30.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:30.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:30.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:30.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:31.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:31.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:31.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:31.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:32.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:32.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:32.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:32.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:33.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:33.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:33.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:33.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:34.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:34.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:34.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:34.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:35.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:35.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:35.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:35.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:36.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:36.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:36.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:36.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:37.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:37.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:37.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:37.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:38.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:38.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:38.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:38.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:39.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:39.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:39.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:39.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:40.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:40.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:40.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:40.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:41.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:41.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:41.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:41.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:42.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:42.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:42.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:42.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:43.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:43.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:44.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:44.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:44.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:44.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:44.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:44.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:45.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:45.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:45.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:45.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:46.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:46.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:46.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:46.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:47.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:47.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:47.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:47.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:48.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:48.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:48.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:48.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:49.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:49.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:49.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:49.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:50.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:50.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:50.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:50.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:51.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:51.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:51.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:51.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:52.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:52.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:52.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:52.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:53.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:53.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:53.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:53.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:54.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:54.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:54.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:54.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:55.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:55.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:55.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:55.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:56.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:56.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:56.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:56.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:57.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:57.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:57.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:57.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:58.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:58.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:58.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:58.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:59.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T00:59:59.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T00:59:59.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T00:59:59.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:00.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:00.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:00.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:00.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:01.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:01.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:01.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:01.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:02.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:02.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:02.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:02.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:03.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:03.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:03.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:03.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:04.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:04.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:04.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:04.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:05.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:05.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:05.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:05.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:06.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:06.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:06.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:06.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:07.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:07.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:07.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:07.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:08.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:08.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:08.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:08.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:09.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:09.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:09.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:09.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:10.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:10.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:10.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:10.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:11.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:11.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:11.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:11.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:12.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:12.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:12.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:12.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:13.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:13.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:13.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:13.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:14.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:14.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:14.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:14.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:15.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:15.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:15.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:15.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:16.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:16.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:16.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:16.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:17.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:17.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:17.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:17.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:18.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:18.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:18.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:18.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:19.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:19.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:19.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:19.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:20.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:20.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:20.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:20.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:21.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:21.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:21.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:21.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:22.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:22.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:22.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:22.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:23.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:23.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:23.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:23.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:24.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:24.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:24.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:24.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:25.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:25.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:25.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:25.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:26.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:26.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:26.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:26.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:27.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:27.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:27.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:27.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:28.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:28.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:28.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:28.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:29.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:29.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:29.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:29.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:30.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:30.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:30.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:30.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:31.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:31.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:31.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:31.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:32.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:32.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:32.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:32.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:33.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:33.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:33.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:33.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:34.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:34.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:34.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:34.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:35.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:35.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:35.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:35.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:36.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:36.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:36.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:36.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:37.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:37.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:37.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:37.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:38.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:38.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:38.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:38.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:39.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:39.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:39.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:39.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:40.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:40.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:40.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:40.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:41.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:41.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:41.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:41.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:42.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:42.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:42.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:42.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:43.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:43.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:43.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:43.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:44.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:44.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:44.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:44.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:45.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:45.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:45.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:45.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:46.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:46.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:46.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:46.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:47.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:47.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:47.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:47.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:48.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:48.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:48.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:48.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:49.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:49.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:49.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:49.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:50.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:50.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:50.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:50.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:51.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:51.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:51.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:51.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:52.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:52.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:52.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:52.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:53.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:53.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:53.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:53.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:54.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:54.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:54.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:54.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:55.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:55.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:55.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:55.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:56.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:56.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:56.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:56.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:57.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:57.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:57.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:57.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:58.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:58.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:58.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:58.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:59.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:00:59.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:00:59.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:00:59.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:00.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:00.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:00.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:00.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:01.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:01.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:01.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:01.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:02.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:02.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:02.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:02.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:03.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:03.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:03.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:03.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:04.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:04.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:04.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:04.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:05.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:05.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:05.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:05.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:06.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:06.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:06.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:06.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:07.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:07.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:07.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:07.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:08.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:08.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:08.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:08.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:09.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:09.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:09.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:09.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:10.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:10.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:10.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:10.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:11.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:11.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 123 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:11.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:11.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:12.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:12.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:12.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:12.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:13.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:13.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:13.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:13.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:14.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:14.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:14.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:14.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:15.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:15.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:15.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:15.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:16.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:16.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:16.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:16.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:17.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:17.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:17.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:17.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:18.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:18.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:18.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:18.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:19.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:19.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:19.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:19.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:20.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:20.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:20.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:20.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:21.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:21.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:21.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:21.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:22.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:22.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:22.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:22.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:23.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:23.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:23.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:23.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:24.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:24.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:24.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:24.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:25.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:25.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:25.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:25.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:26.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:26.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:26.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:26.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:27.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:27.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:28.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:27.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:28.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:28.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:29.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:29.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:29.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:29.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:30.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:30.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:30.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:30.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:31.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:31.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:31.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:31.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:32.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:32.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:32.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:32.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:33.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:33.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:33.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:33.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:34.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:34.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:34.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:34.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:35.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:35.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:35.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:35.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:36.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:36.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:36.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:36.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:37.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:37.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:37.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:37.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:38.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:38.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:38.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:38.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:39.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:39.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:39.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:39.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:40.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:40.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:40.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:40.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:41.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:41.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:41.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:41.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 108 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:42.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:42.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:42.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:42.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:43.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:43.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:43.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:43.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:44.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:44.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:44.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:44.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:45.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:45.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:45.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:45.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:46.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:46.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:46.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:46.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:47.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:47.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:47.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:47.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:48.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:48.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:48.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:48.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:49.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:49.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:49.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:49.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:50.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:50.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:50.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:50.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:51.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:51.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:51.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:51.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:52.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:52.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:52.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:52.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:53.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:53.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:53.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:53.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:54.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:54.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:54.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:54.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:55.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:55.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:55.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:55.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:56.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:56.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:56.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:56.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:57.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:57.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:57.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:57.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:58.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:58.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:58.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:58.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:59.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:01:59.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:01:59.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:01:59.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:00.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:00.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:00.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:00.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:01.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:01.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:01.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:01.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:02.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:02.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:02.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:02.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:03.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:03.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:03.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:03.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:04.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:04.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:04.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:04.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:05.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:05.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:05.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:05.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:06.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:06.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:06.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:06.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:07.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:07.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:07.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:07.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:08.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:08.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:08.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:08.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:09.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:09.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:09.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:09.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:10.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:10.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:10.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:10.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:11.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:11.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:11.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:11.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:12.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:12.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:12.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:12.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:13.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:13.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:13.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:13.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:14.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:14.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:14.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:14.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:15.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:15.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:15.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:15.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:16.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:16.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:16.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:16.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:17.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:17.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:18.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:18.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:18.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:18.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:18.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:18.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:19.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:19.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:20.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:20.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:20.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:20.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:20.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:20.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:21.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:21.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:22.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:22.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:22.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:22.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:23.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:23.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:23.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:23.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:24.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:24.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:24.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:24.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:25.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:25.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:25.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:25.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:26.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:26.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:26.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:26.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:27.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:27.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:27.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:27.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:28.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:28.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:28.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:28.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:29.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:29.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:29.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:29.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:30.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:30.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:30.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:30.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:31.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:31.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:31.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:31.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:32.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:32.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:32.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:32.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:33.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:33.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:33.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:33.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:34.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:34.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:34.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:34.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:35.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:35.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:35.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:35.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:36.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:36.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:36.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:36.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:37.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:37.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:37.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:37.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:38.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:38.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:38.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:38.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:39.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:39.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:39.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:39.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:40.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:40.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:40.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:40.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:41.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:41.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:41.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:41.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:42.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:42.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:42.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:42.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:43.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:43.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:43.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:43.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:44.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:44.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:44.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:44.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:45.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:45.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:45.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:45.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:46.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:46.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:46.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:46.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:47.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:47.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:47.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:47.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:48.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:48.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:48.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:48.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:49.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:49.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:49.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:49.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:50.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:50.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:50.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:50.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:51.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:51.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:51.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:51.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:52.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:52.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:52.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:52.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:53.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:53.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:53.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:53.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:54.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:54.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:54.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:54.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:55.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:55.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:55.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:55.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:56.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:56.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:56.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:56.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:57.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:57.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:57.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:57.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:58.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:58.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:58.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:58.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:59.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:02:59.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:02:59.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:02:59.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:00.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:00.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:00.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:00.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:01.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:01.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:01.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:01.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:02.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:02.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:02.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:02.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:03.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:03.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:03.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:03.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:04.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:04.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:04.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:04.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:05.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:05.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:05.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:05.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:06.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:06.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:06.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:06.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:07.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:07.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:07.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:07.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:08.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:08.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:08.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:08.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:09.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:09.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:09.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:09.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:10.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:10.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:10.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:10.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:11.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:11.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:11.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:11.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:12.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:12.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:12.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:12.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:13.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:13.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:13.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:13.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:14.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:14.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:14.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:14.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:15.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:15.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:15.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:15.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:16.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:16.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:16.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:16.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:17.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:17.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:17.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:17.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:18.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:18.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:18.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:18.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:19.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:19.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:19.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:19.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:20.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:20.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:20.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:20.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:21.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:21.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:21.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:21.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:22.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:22.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:22.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:22.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:23.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:23.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:23.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:23.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:24.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:24.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:24.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:24.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:25.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:25.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:25.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:25.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:26.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:26.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:26.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:26.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:27.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:27.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:27.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:27.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:28.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:28.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:28.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:28.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:29.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:29.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:29.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:29.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:30.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:30.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:30.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:30.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:31.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:31.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:31.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:31.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:32.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:32.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:32.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:32.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:33.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:33.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:33.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:33.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:34.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:34.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:34.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:34.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:35.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:35.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:35.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:35.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:36.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:36.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:36.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:36.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:37.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:37.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:37.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:37.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:38.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:38.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:38.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:38.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:39.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:39.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:39.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:39.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:40.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:40.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:40.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:40.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:41.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:41.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:41.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:41.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:42.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:42.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:42.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:42.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:43.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:43.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:43.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:43.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:44.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:44.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:44.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:44.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:45.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:45.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:45.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:45.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:46.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:46.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:46.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:46.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:47.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:47.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:47.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:47.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:48.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:48.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:48.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:48.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:49.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:49.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:49.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:49.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:50.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:50.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:50.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:50.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:51.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:51.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:51.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:51.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:52.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:52.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:52.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:52.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:53.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:53.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:53.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:53.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:54.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:54.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:54.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:54.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:55.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:55.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:55.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:55.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:56.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:56.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:56.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:56.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:57.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:57.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:57.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:57.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:58.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:58.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:58.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:58.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:59.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:03:59.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:03:59.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:03:59.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:00.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:00.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:00.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:00.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:01.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:01.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:01.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:01.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:02.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:02.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:02.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:02.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:03.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:03.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:03.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:03.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:04.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:04.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:04.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:04.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:05.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:05.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:05.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:05.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:06.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:06.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:06.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:06.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:07.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:07.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:07.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:07.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:08.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:08.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:08.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:08.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:09.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:09.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:09.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:09.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:10.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:10.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:10.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:10.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:11.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:11.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:11.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:11.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:12.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:12.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:12.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:12.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:13.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:13.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:13.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:13.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:14.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:14.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:14.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:14.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:15.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:15.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:15.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:15.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:16.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:16.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:16.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:16.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:17.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:17.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:17.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:17.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:18.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:18.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:18.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:18.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:19.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:19.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:19.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:19.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:20.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:20.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:20.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:20.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:21.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:21.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:21.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:21.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:22.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:22.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:22.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:22.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:23.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:23.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:23.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:23.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:24.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:24.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:24.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:24.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:25.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:25.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:25.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:25.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:26.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:26.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:26.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:26.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:27.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:27.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:27.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:27.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:28.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:28.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:28.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:28.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:29.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:29.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:29.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:29.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:30.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:30.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:30.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:30.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:31.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:31.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:31.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:31.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:32.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:32.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:32.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:32.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:33.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:33.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:33.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:33.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:34.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:34.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:34.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:34.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:35.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:35.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:35.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:35.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:36.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:36.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:36.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:36.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:37.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:37.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:37.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:37.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:38.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:38.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:38.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:38.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:39.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:39.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:39.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:39.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:40.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:40.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:40.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:40.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:41.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:41.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:41.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:41.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:42.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:42.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:42.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:42.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:43.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:43.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:43.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:43.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:44.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:44.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:44.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:44.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:45.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:45.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:45.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:45.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:46.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:46.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:46.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:46.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:47.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:47.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:47.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:47.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:48.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:48.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:48.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:48.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:49.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:49.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:49.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:49.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:50.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:50.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:50.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:50.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:51.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:51.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:51.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:51.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:52.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:52.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:52.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:52.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:53.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:53.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:53.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:53.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:54.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:54.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:54.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:54.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:55.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:55.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:55.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:55.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:56.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:56.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:56.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:56.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:57.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:57.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:57.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:57.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:58.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:58.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:58.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:58.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:59.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:04:59.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:04:59.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:04:59.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:00.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:00.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:00.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:00.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:01.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:01.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:01.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:01.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:02.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:02.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:02.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:02.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:03.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:03.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:03.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:03.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:04.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:04.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:04.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:04.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:05.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:05.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:05.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:05.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:06.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:06.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:06.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:06.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:07.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:07.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:07.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:07.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:08.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:08.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:08.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:08.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:09.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:09.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:09.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:09.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:10.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:10.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:10.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:10.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:11.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:11.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:11.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:11.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:12.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:12.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:12.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:12.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:13.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:13.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:13.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:13.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:14.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:14.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:14.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:14.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:15.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:15.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:15.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:15.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:16.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:16.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:16.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:16.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:17.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:17.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:17.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:17.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:18.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:18.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:18.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:18.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:19.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:19.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:19.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:19.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:20.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:20.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:20.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:20.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:21.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:21.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:21.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:21.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:22.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:22.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:22.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:22.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:23.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:23.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:23.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:23.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:24.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:24.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:24.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:24.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:25.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:25.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:25.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:25.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:26.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:26.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:26.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:26.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:27.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:27.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:27.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:27.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:28.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:28.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:28.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:28.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:29.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:29.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:29.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:29.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:30.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:30.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:30.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:30.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:31.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:31.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:31.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:31.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:32.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:32.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:32.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:32.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:33.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:33.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:33.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:33.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:34.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:34.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:34.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:34.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:35.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:35.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:35.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:35.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:36.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:36.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:36.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:36.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:37.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:37.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:37.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:37.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:38.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:38.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:38.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:38.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:39.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:39.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:39.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:39.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:40.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:40.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:40.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:40.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:41.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:41.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:41.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:41.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:42.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:42.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:42.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:42.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:43.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:43.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:43.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:43.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:44.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:44.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:44.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:44.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:45.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:45.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:45.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:45.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:46.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:46.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:46.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:46.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:47.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:47.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:47.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:47.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:48.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:48.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:48.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:48.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:49.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:49.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:49.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:49.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:50.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:50.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:50.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:50.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:51.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:51.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:51.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:51.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:52.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:52.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:52.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:52.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:53.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:53.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:53.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:53.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:54.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:54.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:54.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:54.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:55.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:55.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:55.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:55.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:56.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:56.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:56.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:56.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:57.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:57.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:57.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:57.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:58.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:58.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:58.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:58.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:59.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:05:59.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:05:59.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:05:59.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:00.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:00.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:00.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:00.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:01.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:01.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:01.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:01.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:02.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:02.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:02.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:02.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:03.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:03.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:03.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:03.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:04.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:04.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:04.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:04.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:05.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:05.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:05.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:05.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:05.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:05.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:06.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:06.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:06.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:06.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:07.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:07.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:07.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:07.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:08.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:08.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:08.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:08.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:09.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:09.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:09.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:09.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:10.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:10.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:10.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:10.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:11.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:11.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:11.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:11.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:12.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:12.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:12.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:12.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:13.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:13.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:13.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:13.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:14.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:14.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:14.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:14.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:15.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:15.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:15.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:15.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:16.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:16.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:16.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:16.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:17.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:17.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:17.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:17.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:18.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:18.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:18.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:18.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:19.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:19.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:19.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:19.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:20.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:20.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:20.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:20.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:21.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:21.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:21.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:21.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:22.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:22.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:22.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:22.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:23.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:23.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:23.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:23.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:24.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:24.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:25.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:25.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:25.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:25.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:26.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:26.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:26.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:26.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:27.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:27.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:27.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:27.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:28.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:28.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:28.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:28.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:29.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:29.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:29.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:29.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:30.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:30.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:30.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:30.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:31.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:31.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:31.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:31.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:32.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:32.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:32.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:32.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:33.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:33.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:33.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:33.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:34.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:34.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:34.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:34.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:35.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:35.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:35.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:35.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:36.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:36.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:36.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:36.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:37.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:37.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:37.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:37.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:38.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:38.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:38.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:38.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:39.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:39.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:39.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:39.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:40.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:40.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:40.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:40.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:41.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:41.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:41.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:41.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:42.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:42.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:42.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:42.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:43.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:43.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:43.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:43.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:44.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:44.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:44.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:44.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:45.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:45.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:45.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:45.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:46.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:46.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:46.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:46.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:47.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:47.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:47.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:47.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:48.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:48.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:48.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:48.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:49.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:49.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:49.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:49.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:50.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:50.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:50.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:50.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:51.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:51.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:51.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:51.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:52.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:52.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:52.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:52.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:53.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:53.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:53.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:53.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:54.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:54.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:54.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:54.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:55.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:55.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:55.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:55.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:56.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:56.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:56.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:56.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:57.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:57.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:57.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:57.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:58.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:58.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:58.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:58.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:59.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:06:59.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:06:59.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:06:59.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:00.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:00.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:00.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:00.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:01.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:01.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:01.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:01.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:02.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:02.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:02.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:02.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:03.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:03.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:03.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:03.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:04.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:04.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:04.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:04.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:05.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:05.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:05.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:05.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:06.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:06.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:06.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:06.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:07.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:07.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:07.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:07.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:08.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:08.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:08.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:08.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:09.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:09.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:09.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:09.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:10.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:10.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:10.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:10.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:11.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:11.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:11.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:11.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:12.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:12.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:12.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:12.159+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:13.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:13.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:13.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:13.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:14.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:14.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:14.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:14.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:15.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:15.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:15.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:15.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:16.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:16.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:16.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:16.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:17.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:17.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:17.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:17.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:18.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:18.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:18.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:18.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:19.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:19.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:19.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:19.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:20.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:20.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:20.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:20.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:21.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:21.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:21.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:21.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:22.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:22.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:22.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:22.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:23.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:23.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:23.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:23.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:24.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:24.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:24.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:24.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:25.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:25.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:25.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:25.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:26.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:26.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:26.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:26.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:27.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:27.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:27.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:27.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:28.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:28.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:28.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:28.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:29.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:29.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:29.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:29.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:30.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:30.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:30.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:30.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:31.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:31.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:31.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:31.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:31.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:32.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:32.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:32.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:33.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:33.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:33.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:33.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:34.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:34.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:34.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:34.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:35.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:35.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:35.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:35.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:36.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:36.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:36.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:36.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:37.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:37.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:37.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:37.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:38.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:38.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:38.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:38.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:39.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:39.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:39.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:39.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:39.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:39.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:40.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:40.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:40.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:40.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:41.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:41.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:41.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:41.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:42.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:42.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:42.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:42.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:43.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:43.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:43.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:44.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:44.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:44.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:44.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:44.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:44.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:44.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:45.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:45.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:45.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:46.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:46.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:46.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:46.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:46.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:47.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:47.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:47.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:47.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:48.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:48.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:48.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:48.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:49.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:49.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:49.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:49.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:50.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:50.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:50.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:50.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:51.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:51.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:52.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:52.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:52.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:52.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:52.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:53.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:53.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:53.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:53.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:53.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:54.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:54.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:55.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:55.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:55.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:55.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:56.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:56.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:56.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:56.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:57.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:57.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:57.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:58.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:58.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:58.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:59.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:07:59.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:07:59.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:07:59.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:00.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:00.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:00.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:00.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:01.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:01.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:01.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:01.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:02.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:02.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:02.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:02.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:03.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:03.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:03.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:03.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:04.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:04.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:04.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:04.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:05.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:05.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:05.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:05.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:06.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:06.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:06.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:06.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:07.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:07.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:07.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:07.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:08.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:08.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:08.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:08.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:09.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:09.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:09.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:09.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:10.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:10.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:10.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:10.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:11.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:11.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:11.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:11.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:12.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:12.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:12.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:12.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:13.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:13.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:13.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:13.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:14.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:14.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:14.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:14.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:15.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:15.036+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:15.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:15.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:16.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:16.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:16.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:16.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:17.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:17.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:17.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:17.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:18.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:18.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:18.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:18.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:19.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:19.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:19.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:19.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:20.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:20.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:20.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:20.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:21.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:21.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:21.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:21.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:22.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:22.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:22.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:22.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:23.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:23.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:23.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:23.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:24.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:24.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:24.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:24.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:25.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:25.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:25.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:25.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:26.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:26.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:26.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:26.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:27.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:27.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:27.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:27.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:28.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:28.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:28.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:28.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:29.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:29.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:29.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:29.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:30.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:30.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:30.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:30.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:31.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:31.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:31.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:31.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:32.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:32.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:32.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:32.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:33.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:33.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:33.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:33.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:34.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:34.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:34.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:34.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:35.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:35.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:35.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:35.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:36.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:36.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:36.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:36.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:37.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:37.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:37.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:37.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:38.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:38.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:38.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:38.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:39.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:39.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:39.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:39.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:40.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:40.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:40.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:40.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:41.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:41.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:41.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:41.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:42.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:42.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:42.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:42.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:43.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:43.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:43.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:43.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:44.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:44.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:44.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:44.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:45.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:45.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:45.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:45.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:46.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:46.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:46.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:46.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:47.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:47.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:47.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:47.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:48.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:48.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:48.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:48.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:49.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:49.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:49.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:49.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:50.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:50.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:50.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:50.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:51.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:51.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:51.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:51.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:52.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:52.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:52.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:52.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:53.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:53.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:53.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:53.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:54.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:54.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:54.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:54.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:55.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:55.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:55.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:55.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:56.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:56.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:56.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:56.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:57.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:57.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:57.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:57.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:58.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:58.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:58.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:58.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:59.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:08:59.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:08:59.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:08:59.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:00.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:00.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:00.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:00.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:01.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:01.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:01.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:01.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:02.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:02.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:02.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:02.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:03.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:03.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:03.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:03.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:04.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:04.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:04.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:04.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:05.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:05.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:05.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:05.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:06.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:06.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:06.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:06.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:07.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:07.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:07.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:07.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:08.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:08.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:08.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:08.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:09.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:09.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:09.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:09.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:10.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:10.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:10.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:10.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:11.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:11.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:11.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:11.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:12.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:12.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:12.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:12.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:13.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:13.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:13.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:13.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:14.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:14.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:14.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:14.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:15.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:15.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:15.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:15.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:16.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:16.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:16.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:16.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:17.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:17.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:17.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:17.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:18.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:18.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:18.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:18.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:19.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:19.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:19.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:19.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:20.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:20.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:20.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:20.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:21.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:21.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:21.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:21.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:22.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:22.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:22.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:22.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:23.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:23.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:23.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:23.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:24.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:24.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:24.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:24.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:25.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:25.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:25.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:25.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:26.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:26.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:26.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:26.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:27.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:27.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:27.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:27.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:28.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:28.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:28.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:28.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:29.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:29.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:29.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:29.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:30.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:30.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:30.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:30.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:31.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:31.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:31.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:31.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:32.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:32.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:32.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:32.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:33.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:33.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:33.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:33.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:34.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:34.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:34.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:34.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:35.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:35.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:35.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:35.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:36.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:36.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:36.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:36.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:37.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:37.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:37.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:37.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:38.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:38.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:38.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:38.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:39.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:39.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:39.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:39.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:40.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:40.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:40.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:40.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:41.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:41.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:41.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:41.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:42.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:42.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:42.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:42.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:43.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:43.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:43.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:43.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:44.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:44.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:44.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:44.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:45.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:45.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:45.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:45.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:46.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:46.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:46.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:46.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:47.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:47.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:47.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:47.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:48.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:48.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:48.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:48.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:49.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:49.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:49.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:49.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:50.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:50.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:50.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:50.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:51.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:51.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:51.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:51.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:52.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:52.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:52.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:52.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:53.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:53.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:53.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:53.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:54.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:54.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:54.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:54.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:55.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:55.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:55.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:55.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:56.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:56.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:56.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:56.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:57.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:57.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:57.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:57.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:58.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:58.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:58.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:58.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:59.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:09:59.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:09:59.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:09:59.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:00.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:00.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:00.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:00.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:01.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:01.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:01.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:01.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:02.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:02.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:02.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:02.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:03.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:03.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:03.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:03.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:04.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:04.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:04.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:04.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:05.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:05.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:05.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:05.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:06.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:06.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:06.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:06.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:07.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:07.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:07.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:07.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:08.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:08.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:08.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:08.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:09.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:09.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:09.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:09.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:10.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:10.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:10.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:10.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:11.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:11.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:11.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:11.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:12.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:12.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:12.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:12.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:13.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:13.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:13.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:13.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:14.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:14.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:14.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:14.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:15.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:15.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:15.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:15.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:16.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:16.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:16.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:16.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:17.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:17.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:17.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:17.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:18.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:18.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:18.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:18.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:19.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:19.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:19.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:19.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:20.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:20.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:20.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:20.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:21.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:21.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:21.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:21.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:22.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:22.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:22.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:22.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:23.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:23.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:23.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:23.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:24.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:24.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:24.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:24.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:25.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:25.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:25.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:25.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:26.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:26.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:26.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:26.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:27.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:27.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:27.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:27.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:28.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:28.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:28.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:28.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:29.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:29.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:29.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:29.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:30.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:30.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:30.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:30.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:31.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:31.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:31.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:31.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:32.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:32.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:32.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:32.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:33.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:33.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:33.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:33.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:34.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:34.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:34.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:34.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:35.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:35.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:35.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:35.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:36.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:36.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:36.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:36.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:37.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:37.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:37.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:37.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:38.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:38.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:38.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:38.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:39.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:39.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:39.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:39.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:40.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:40.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:40.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:40.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:41.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:41.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:41.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:41.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:42.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:42.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:42.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:42.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:43.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:43.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:43.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:43.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:44.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:44.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:44.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:44.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:45.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:45.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:45.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:45.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:46.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:46.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:46.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:46.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:47.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:47.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:47.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:47.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:48.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:48.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:48.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:48.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:49.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:49.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:49.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:49.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:50.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:50.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:50.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:50.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:51.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:51.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:51.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:51.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:52.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:52.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:52.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:52.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:53.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:53.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:53.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:53.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:54.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:54.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:54.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:54.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:55.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:55.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:55.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:55.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:56.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:56.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:56.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:56.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:57.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:57.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:57.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:57.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:58.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:58.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:58.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:58.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:59.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:10:59.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:10:59.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:10:59.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:00.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:00.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:00.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:00.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:01.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:01.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:01.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:01.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:02.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:02.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:02.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:02.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:03.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:03.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:03.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:03.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:04.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:04.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:04.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:04.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:05.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:05.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:05.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:05.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:06.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:06.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:06.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:06.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:07.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:07.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:07.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:07.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:08.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:08.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:08.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:08.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:09.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:09.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:09.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:09.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:10.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:10.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:10.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:10.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:11.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:11.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:11.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:11.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:12.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:12.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:12.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:12.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:13.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:13.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:13.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:13.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:14.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:14.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:14.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:14.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:15.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:15.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:15.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:15.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:16.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:16.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:16.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:16.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:17.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:17.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:17.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:17.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:18.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:18.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:18.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:18.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:19.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:19.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:19.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:19.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:20.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:20.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:20.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:20.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:21.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:21.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:21.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:21.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:22.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:22.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:22.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:22.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:23.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:23.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:23.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:23.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:24.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:24.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:24.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:24.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:25.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:25.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:25.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:25.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:26.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:26.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:26.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:26.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:27.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:27.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:27.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:27.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:28.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:28.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:28.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:28.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:29.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:29.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:29.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:29.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:30.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:30.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:30.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:30.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:31.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:31.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:31.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:31.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:32.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:32.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:32.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:32.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:33.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:33.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:33.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:33.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:34.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:34.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:34.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:34.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:35.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:35.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:35.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:35.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:36.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:36.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:36.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:36.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:37.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:37.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:37.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:37.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:38.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:38.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:38.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:38.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:39.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:39.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:39.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:39.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:40.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:40.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:40.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:40.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:41.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:41.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:41.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:41.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:42.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:42.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:42.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:42.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:43.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:43.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:43.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:43.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:44.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:44.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:44.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:44.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:45.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:45.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:45.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:45.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:46.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:46.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:46.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:46.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:47.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:47.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:47.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:47.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:48.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:48.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:48.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:48.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:49.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:49.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:49.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:49.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:50.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:50.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:50.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:50.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:51.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:51.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:51.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:51.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:52.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:52.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:52.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:52.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:53.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:53.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:53.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:53.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:54.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:54.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:54.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:54.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:55.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:55.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:55.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:55.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:56.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:56.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:56.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:56.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:57.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:57.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:57.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:57.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:58.418 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:58.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:58.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:58.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:59.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:11:59.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:11:59.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:11:59.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:00.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:00.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:00.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:00.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:01.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:01.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:01.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:01.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:02.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:02.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:02.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:02.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:03.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:03.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:03.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:03.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:04.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:04.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:04.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:04.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:05.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:05.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:05.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:05.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:06.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:06.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:06.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:06.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:07.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:07.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:07.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:07.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:08.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:08.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:08.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:08.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:09.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:09.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:09.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:09.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:10.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:10.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:10.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:10.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:11.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:11.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:11.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:11.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:12.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:12.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:12.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:12.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:13.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:13.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:13.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:13.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:14.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:14.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:14.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:14.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:15.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:15.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:15.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:15.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:16.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:16.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:16.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:16.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:17.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:17.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:17.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:17.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:18.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:18.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:18.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:18.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:19.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:19.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:19.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:19.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:20.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:20.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:20.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:20.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:21.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:21.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:21.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:21.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:22.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:22.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:22.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:22.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:23.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:23.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:23.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:23.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:24.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:24.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:24.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:24.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:25.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:25.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:25.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:25.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:26.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:26.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:26.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:26.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:27.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:27.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:27.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:27.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:28.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:28.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:28.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:28.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:29.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:29.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:29.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:29.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:30.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:30.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:30.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:30.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:31.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:31.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:31.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:31.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:32.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:32.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:32.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:32.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:33.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:33.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:33.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:33.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:34.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:34.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:34.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:34.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:35.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:35.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:35.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:35.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:36.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:36.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:36.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:36.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:37.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:37.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:37.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:37.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:38.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:38.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:38.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:38.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:39.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:39.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:39.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:39.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:40.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:40.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:40.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:40.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:41.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:41.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:41.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:41.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:42.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:42.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:42.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:42.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:43.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:43.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:43.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:43.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:44.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:44.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:44.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:44.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:45.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:45.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:45.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:45.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:46.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:46.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:46.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:46.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:47.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:47.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:47.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:47.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:48.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:48.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:48.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:48.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:49.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:49.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:49.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:49.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:50.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:50.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:50.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:50.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:50.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:51.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:51.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:51.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:52.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:52.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:52.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:52.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:53.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:53.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:53.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:53.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:54.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:54.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:54.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:54.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:55.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:55.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:55.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:55.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:56.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:56.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:56.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:56.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:57.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:57.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:57.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:57.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:58.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:58.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:58.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:58.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:59.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:12:59.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:12:59.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:12:59.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:00.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:00.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:00.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:00.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:01.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:01.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:01.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:01.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:02.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:02.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:02.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:02.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:03.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:03.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:03.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:03.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:04.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:04.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:04.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:04.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:05.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:05.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:05.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:05.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:06.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:06.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:06.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:06.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:07.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:07.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:07.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:07.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:08.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:08.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:08.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:08.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:09.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:09.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:09.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:09.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:10.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:10.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:10.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:10.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:11.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:11.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:11.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:11.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:12.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:12.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:12.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:12.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:13.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:13.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:13.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:13.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:14.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:14.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:14.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:14.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:15.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:15.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:15.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:15.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:16.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:16.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:16.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:16.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:17.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:17.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:17.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:17.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:18.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:18.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:18.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:18.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:19.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:19.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:19.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:19.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:20.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:20.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:20.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:20.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:20.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:21.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:21.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:21.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:21.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:21.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:22.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:22.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:22.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:22.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:23.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:23.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:23.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:23.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:24.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:24.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:24.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:24.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:25.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:25.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:25.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:25.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:26.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:26.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:26.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:26.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:27.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:27.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:27.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:27.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:28.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:28.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:28.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:28.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:29.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:29.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:29.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:29.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:30.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:30.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:30.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:30.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:31.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:31.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:31.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:31.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:32.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:32.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:32.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:32.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:33.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:33.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:33.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:33.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:34.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:34.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:34.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:34.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:35.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:35.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:35.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:35.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:36.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:36.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:36.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:36.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:37.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:37.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:37.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:37.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:38.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:38.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:38.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:38.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:39.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:39.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:39.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:39.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:40.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:40.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:40.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:40.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:41.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:41.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:41.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:41.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:42.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:42.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:42.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:42.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:43.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:43.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:43.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:43.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:44.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:44.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:44.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:44.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:45.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:45.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:45.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:45.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:46.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:46.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:46.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:46.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:47.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:47.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:47.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:47.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:48.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:48.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:48.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:48.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:49.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:49.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:49.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:49.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:50.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:50.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:50.548 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-23T01:13:50.565+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81a8004bb0 msgr2=0x7f81ac0b8ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-23T01:13:50.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:50.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:51.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:51.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:51.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:51.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:52.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:52.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:52.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:52.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:53.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:53.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:53.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:53.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:54.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:54.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:54.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:54.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:55.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:55.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:55.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:55.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:56.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:56.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:56.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:56.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:57.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:57.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:57.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:57.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:58.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:58.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:58.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:58.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:59.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:13:59.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:13:59.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:13:59.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:00.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:00.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:00.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:00.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:01.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:01.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:01.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:01.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:02.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:02.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:02.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:02.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:03.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:03.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:03.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:03.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:04.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:04.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:04.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:04.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:05.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:05.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:05.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:05.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:06.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:06.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:06.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:06.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:07.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:07.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:07.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:07.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:08.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:08.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:08.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:08.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:09.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:09.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:09.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:09.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:10.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:10.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:10.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:10.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:11.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:11.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:11.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:11.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:12.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:12.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:12.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:12.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:13.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:13.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:13.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:13.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:14.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:14.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:14.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:14.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:15.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:15.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:15.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:15.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:16.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:16.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:16.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:16.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:17.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:17.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:17.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:17.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:18.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:18.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:18.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:18.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:19.210 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:19.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:19.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:19.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:20.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:20.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:20.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:20.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:21.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:21.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:21.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:21.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:22.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:22.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:22.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:22.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:23.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:23.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:23.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:23.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:24.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:24.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:24.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:24.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:25.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:25.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:25.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:25.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:26.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:26.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:26.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:26.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:27.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:27.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:27.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:27.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:28.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:28.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:28.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:28.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:29.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:29.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:29.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:29.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:30.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:30.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:30.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:30.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:31.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:31.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:31.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:31.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:32.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:32.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:32.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:32.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:33.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:33.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:33.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:33.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:34.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:34.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:34.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:34.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:35.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:35.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:35.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:35.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:36.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:36.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:36.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:36.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:37.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:37.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:37.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:37.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:38.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:38.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:38.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:38.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:39.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:39.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:39.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:39.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:40.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:40.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:40.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:40.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:41.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:41.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:41.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:41.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:42.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:42.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:42.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:42.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:43.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:43.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:43.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:43.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:44.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:44.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:44.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:44.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:45.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:45.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:45.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:45.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:46.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:46.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:46.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:46.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:47.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:47.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:47.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:47.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:48.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:48.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:48.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:48.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:49.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:49.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:49.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:49.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:50.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:50.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:50.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:50.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:51.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:51.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:51.760 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:51.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:52.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:52.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:52.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:52.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:53.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:53.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:53.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:53.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:54.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:54.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:54.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:54.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:55.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:55.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:55.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:55.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:56.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:56.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:56.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:56.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:57.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:57.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:57.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:57.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:58.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:58.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:58.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:58.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:59.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:14:59.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:14:59.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:14:59.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:00.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:00.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:00.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:00.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:01.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:01.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:02.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:02.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:02.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:02.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:03.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:03.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:03.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:03.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:04.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:04.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:04.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:04.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:05.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:05.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:05.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:05.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:06.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:06.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:06.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:06.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:07.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:07.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:07.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:07.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:08.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:08.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:08.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:08.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:09.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:09.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:09.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:09.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:10.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:10.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:10.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:10.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:11.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:11.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:11.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:11.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:12.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:12.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:12.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:12.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:13.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:13.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:13.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:13.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:14.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:14.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:14.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:14.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:15.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:15.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:15.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:15.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:16.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:16.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:16.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:16.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:17.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:17.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:17.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:17.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:18.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:18.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:18.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:18.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:19.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:19.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:19.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:19.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:20.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:20.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:20.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:20.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:21.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:21.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:21.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:21.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:22.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:22.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:22.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:22.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:23.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:23.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:23.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:23.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:24.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:24.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:24.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:24.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:25.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:25.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:25.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:25.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:26.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:26.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:26.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:26.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:27.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:27.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:27.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:27.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:28.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:28.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:28.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:28.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:29.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:29.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:29.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:29.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:30.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:30.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:30.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:30.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:31.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:31.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:31.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:31.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:32.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:32.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:32.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:32.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:33.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:33.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:33.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:33.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:34.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:34.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:34.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:34.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:35.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:35.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:35.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:35.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:36.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:36.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:36.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:36.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:37.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:37.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:37.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:37.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:38.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:38.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:38.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:38.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:39.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:39.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:39.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:39.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:40.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:40.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:40.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:40.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:41.147 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:41.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:41.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:41.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:42.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:42.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:42.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:42.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:43.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:43.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:43.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:43.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:44.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:44.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:44.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:44.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:45.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:45.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:45.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:45.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:46.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:46.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:46.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:46.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:47.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:47.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:47.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:47.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:48.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:48.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:48.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:48.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:49.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:49.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:49.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:49.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:50.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:50.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:50.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:50.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:51.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:51.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:51.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:51.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:52.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:52.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:52.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:52.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:53.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:53.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:53.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:53.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:54.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:54.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:54.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:54.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:55.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:55.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:55.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:55.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:56.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:56.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:56.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:56.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:57.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:57.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:57.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:57.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:58.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:58.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:58.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:58.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:59.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:15:59.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:15:59.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:15:59.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:00.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:00.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:00.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:00.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:01.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:01.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:01.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:01.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:02.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:02.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:02.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:02.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:03.181 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:03.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:03.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:03.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:04.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:04.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:04.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:04.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:05.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:05.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:05.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:05.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:06.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:06.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:06.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:06.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:07.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:07.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:07.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:07.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:08.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:08.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:08.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:08.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:09.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:09.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:09.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:09.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:10.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:10.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:10.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:10.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:11.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:11.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:11.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:11.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 126 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:12.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:12.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:12.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:12.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:13.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:13.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:13.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:13.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:14.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:14.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:14.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:14.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:15.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:15.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:15.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:15.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:16.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:16.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:16.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:16.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:17.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:17.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:17.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:17.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:18.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:18.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:18.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:18.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:19.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:19.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:19.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:19.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:20.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:20.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:20.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:20.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:21.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:21.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:21.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:21.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:22.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:22.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:22.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:22.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:23.207 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:23.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:23.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:23.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:24.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:24.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:24.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:24.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:25.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:25.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:25.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:25.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:26.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:26.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:26.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:26.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:27.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:27.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:27.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:27.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:28.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:28.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:28.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:28.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:29.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:29.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:29.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:29.212+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:30.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:30.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:30.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:30.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:31.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:31.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:31.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:31.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:32.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:32.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:32.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:32.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:33.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:33.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:33.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:33.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:34.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:34.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:34.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:34.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:35.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:35.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:35.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:35.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:36.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:36.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:36.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:36.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:37.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:37.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:37.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:37.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:38.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:38.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:38.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:38.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:39.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:39.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:39.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:39.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:40.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:40.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:40.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:40.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:41.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:41.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 57 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:16:41.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:41.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:42.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:42.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:42.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:42.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:43.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:43.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:43.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:43.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:44.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:44.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:44.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:44.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:45.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:45.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:45.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:45.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:46.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:46.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:46.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:46.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:47.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:47.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:47.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:47.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:48.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:48.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:48.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:48.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:49.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:49.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:49.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:49.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:50.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:50.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:50.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:50.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:51.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:51.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:51.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:51.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:52.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:52.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:52.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:52.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:53.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:53.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:53.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:53.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:54.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:54.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:54.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:54.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:55.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:55.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:55.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:55.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:56.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:56.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:56.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:56.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:57.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:57.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:57.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:57.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:58.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:58.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:58.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:58.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:59.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:16:59.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:16:59.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:16:59.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:00.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:00.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:00.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:00.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:01.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:01.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:01.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:01.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:02.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:02.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:02.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:02.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:03.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:03.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:03.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:03.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:04.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:04.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:04.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:04.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:05.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:05.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:05.242 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:05.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:06.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:06.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:06.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:06.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:07.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:07.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:07.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:07.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:08.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:08.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:08.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:08.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:09.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:09.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:09.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:09.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:10.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:10.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:10.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:10.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:11.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:11.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:11.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:11.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:12.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:12.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:12.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:12.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:13.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:13.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:13.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:13.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:14.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:14.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:14.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:14.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:15.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:15.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:15.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:15.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:16.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:16.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:16.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:16.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:16.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:16.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:17.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:17.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:17.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:18.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:18.115 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:18.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:19.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:19.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:19.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:19.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:20.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:20.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:20.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:20.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:21.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:21.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:21.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:21.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:22.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:22.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:22.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:22.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:23.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:23.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:23.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:23.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:23.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:24.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:24.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:24.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:24.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:24.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:25.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:25.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:25.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:26.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:26.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:26.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:26.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:27.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:27.035 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:27.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:27.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:28.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:28.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:28.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:28.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:29.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:29.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:29.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:30.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:30.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:30.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:30.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:31.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:31.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:31.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:31.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:32.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:32.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:32.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:32.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:33.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:33.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:33.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:33.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:34.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:34.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:34.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:34.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:34.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:35.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:35.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:35.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:35.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:36.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:36.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:36.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:36.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:36.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:37.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:37.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:37.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:37.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:38.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:38.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:38.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:38.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:39.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:39.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:39.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:40.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:40.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:40.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:40.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:40.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:41.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:41.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:41.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:41.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:42.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:42.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:42.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:43.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:43.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:43.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:43.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:44.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:44.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:44.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:44.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:44.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:45.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:45.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:45.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:45.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:46.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:46.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:46.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:46.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:47.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:47.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:47.948 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:47.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:48.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:48.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:48.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:48.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:49.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:49.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:49.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:49.956+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:50.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:50.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:50.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:50.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:51.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:51.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:51.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:51.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:52.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:52.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:52.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:53.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:53.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:53.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:53.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:54.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:54.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:54.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:55.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:55.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:55.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:55.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:55.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:55.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:56.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:56.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:56.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:56.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:57.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:57.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:57.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:57.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:58.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:58.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:58.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:58.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:59.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:17:59.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:17:59.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:17:59.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:00.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:00.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:00.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:00.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:01.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:01.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:01.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:01.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:02.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:02.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:02.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:02.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:03.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:03.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:03.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:03.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:04.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:04.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:04.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:04.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:05.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:05.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:05.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:05.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:06.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:06.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:06.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:06.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:07.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:07.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:07.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:07.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:08.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:08.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:08.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:08.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:09.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:09.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:09.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:09.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:10.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:10.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:10.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:10.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:11.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:11.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:11.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:11.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:12.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:12.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:12.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:12.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:13.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:13.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:13.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:13.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:14.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:14.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:14.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:14.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:15.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:15.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:15.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:15.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:16.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:16.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:16.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:16.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:17.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:17.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:17.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:17.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:18.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:18.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:18.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:18.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:19.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:19.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:19.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:19.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:20.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:20.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:20.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:20.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:21.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:21.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:21.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:21.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:22.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:22.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:22.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:22.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:23.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:23.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:23.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:23.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:24.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:24.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:24.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:24.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:25.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:25.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:25.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:25.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:26.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:26.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:26.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:26.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:27.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:27.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:27.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:27.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:28.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:28.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:28.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:28.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:29.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:29.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:29.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:30.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:30.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:30.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:31.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:31.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:31.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:31.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:32.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:32.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:32.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:32.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:33.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:33.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:33.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:33.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:34.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:34.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:34.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:34.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:35.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:35.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:35.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:35.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:36.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:36.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:36.053 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:36.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:36.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:37.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:37.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:37.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:37.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:38.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:38.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:38.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:38.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:38.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:39.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:39.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:39.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:39.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:40.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:40.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:40.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:40.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:41.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:41.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:41.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:41.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:42.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:42.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:42.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:42.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:43.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:43.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:43.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:43.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:44.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:44.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:44.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:44.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:45.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:45.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:45.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:45.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:46.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:46.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:46.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:46.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:47.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:47.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:47.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:47.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:47.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:48.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:48.845 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:48.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:48.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:48.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:49.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:49.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:49.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:49.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:50.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:50.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:50.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:50.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:51.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:51.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:51.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:51.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:52.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:52.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:52.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:52.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:53.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:53.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:53.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:53.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:54.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:54.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:54.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:54.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:55.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:55.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:55.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:55.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:56.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:56.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:56.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:56.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:57.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:57.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:57.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:57.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:58.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:58.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:58.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:58.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:59.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:18:59.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:18:59.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:18:59.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:00.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:00.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:00.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:00.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:01.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:01.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:01.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:01.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:02.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:02.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:02.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:02.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:03.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:03.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:03.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:03.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:04.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:04.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:04.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:05.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:05.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:05.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:06.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:06.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:06.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:06.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:07.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:07.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:07.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:07.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:08.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:08.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:08.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:08.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:09.015 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:09.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:09.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:09.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:10.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:10.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:10.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:10.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:11.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:11.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:11.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:11.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:12.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:12.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:12.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:12.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:13.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:13.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:13.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:13.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:14.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:14.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:14.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:14.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:15.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:15.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:15.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:15.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:16.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:16.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:16.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:16.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:17.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:17.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:17.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:17.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:18.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:18.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:18.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:18.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:19.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:19.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:19.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:19.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:20.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:20.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:20.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:21.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:21.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:21.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:22.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:22.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:22.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:22.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:23.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:23.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:23.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:23.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:24.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:24.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:24.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:24.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:25.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:25.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:25.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:25.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:26.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:26.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:26.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:26.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:27.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:27.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:27.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:27.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:28.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:28.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:28.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:28.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:29.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:29.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:29.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:29.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:30.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:30.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:30.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:30.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:31.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:31.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:31.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:31.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:32.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:32.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:32.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:32.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:32.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:33.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:33.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:33.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:33.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:33.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:34.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:34.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:34.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:34.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:35.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:35.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:35.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:35.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:36.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:36.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:36.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:36.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:37.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:37.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:37.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:37.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:38.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:38.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:38.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:38.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:39.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:39.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:39.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:39.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:40.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:40.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:40.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:40.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:41.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:41.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:41.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:41.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:42.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:42.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:42.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:42.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:43.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:43.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:43.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:43.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:44.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:44.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:44.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:44.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:45.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:45.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:45.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:45.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:46.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:46.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:46.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:46.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:47.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:47.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:47.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:47.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:48.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:48.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:48.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:48.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:49.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:49.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:49.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:49.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:50.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:50.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:50.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:50.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:51.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:51.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:51.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:51.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:52.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:52.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:52.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:52.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:53.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:53.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:53.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:53.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:54.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:54.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:54.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:54.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:55.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:55.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:55.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:55.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:56.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:56.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:56.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:56.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:57.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:57.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:57.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:57.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:58.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:58.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:58.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:58.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:59.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:19:59.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:19:59.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:19:59.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:00.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:00.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:00.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:00.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:01.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:01.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:01.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:01.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:02.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:02.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:02.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:02.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:03.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:03.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:03.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:03.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:04.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:04.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:04.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:04.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:05.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:05.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:05.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:05.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:06.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:06.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:06.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:06.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:07.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:07.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:07.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:07.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:08.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:08.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:08.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:08.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:09.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:09.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:09.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:09.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:10.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:10.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:10.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:10.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:11.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:11.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:11.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:11.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:12.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:12.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:12.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:12.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:13.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:13.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:13.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:13.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:14.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:14.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:14.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:14.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:15.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:15.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:15.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:15.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:16.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:16.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:16.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:16.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:17.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:17.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:17.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:17.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:18.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:18.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:18.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:18.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:19.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:19.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:19.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:19.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:20.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:20.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:20.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:20.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:21.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:21.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:21.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:21.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:22.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:22.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:22.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:22.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:23.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:23.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:23.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:23.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:24.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:24.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:24.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:24.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:25.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:25.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:25.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:25.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:26.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:26.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:26.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:26.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:27.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:27.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:27.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:27.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:28.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:28.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:28.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:28.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:29.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:29.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:29.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:29.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:30.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:30.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:30.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:30.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:31.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:31.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:31.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:31.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:32.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:32.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:32.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:32.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:33.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:33.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:33.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:33.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:34.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:34.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:34.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:34.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:35.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:35.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:35.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:35.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:36.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:36.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:36.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:36.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:37.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:37.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:37.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:37.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:38.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:38.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:38.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:38.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:39.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:39.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:39.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:39.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:40.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:40.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:40.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:40.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:41.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:41.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:41.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:41.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:42.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:42.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:42.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:42.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:43.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:43.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:43.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:43.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:44.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:44.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:44.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:44.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:45.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:45.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:45.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:45.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:46.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:46.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:46.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:46.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:47.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:47.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:47.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:47.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:48.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:48.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:48.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:48.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:49.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:49.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:49.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:49.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:50.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:50.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:50.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:50.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:51.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:51.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:51.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:51.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:52.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:52.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:52.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:52.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:53.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:53.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:53.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:53.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:54.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:54.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:54.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:54.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:55.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:55.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:55.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:55.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:56.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:56.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:56.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:56.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:57.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:57.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:57.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:57.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:58.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:58.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:58.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:58.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:59.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:20:59.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:20:59.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:20:59.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:00.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:00.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:00.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:00.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:01.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:01.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:01.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:01.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:02.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:02.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:02.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:02.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:03.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:03.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:03.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:03.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:04.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:04.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:04.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:04.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:05.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:05.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:05.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:05.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:06.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:06.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:06.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:06.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:07.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:07.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:07.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:07.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:08.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:08.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:08.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:08.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:09.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:09.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:09.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:09.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:10.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:10.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:10.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:10.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:11.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:11.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:11.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:11.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:12.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:12.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:12.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:12.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:13.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:13.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:13.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:13.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:14.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:14.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:14.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:14.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:15.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:15.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:15.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:15.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:16.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:16.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:16.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:16.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:17.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:17.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:17.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:17.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:18.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:18.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:18.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:18.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:19.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:19.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:19.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:19.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:20.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:20.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:20.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:20.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:21.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:21.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:21.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:21.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:22.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:22.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:22.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:22.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:23.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:23.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:23.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:23.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:24.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:24.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:24.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:24.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:25.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:25.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:25.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:25.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:26.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:26.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:26.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:26.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:27.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:27.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:27.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:27.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:28.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:28.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:28.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:28.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:29.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:29.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:29.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:29.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:30.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:30.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:30.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:30.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:31.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:31.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:31.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:31.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:32.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:32.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:32.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:32.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:33.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:33.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:33.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:33.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:34.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:34.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:34.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:34.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:35.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:35.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:35.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:35.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:36.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:36.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:36.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:36.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:37.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:37.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:37.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:37.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:38.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:38.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:38.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:38.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:39.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:39.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:39.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:39.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:40.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:40.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:40.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:40.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:41.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:41.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:41.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:41.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:42.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:42.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:42.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:42.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:43.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:43.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:43.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:43.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:44.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:44.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:44.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:44.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:45.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:45.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:45.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:45.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:46.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:46.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:46.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:46.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:47.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:47.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:47.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:47.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:48.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:48.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:48.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:48.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:49.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:49.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:49.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:49.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:50.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:50.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:50.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:50.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:51.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:51.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:51.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:51.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:52.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:52.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:52.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:52.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:53.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:53.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:53.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:53.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:54.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:54.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:54.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:54.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:55.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:55.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:55.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:55.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:56.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:56.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:56.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:56.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:57.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:57.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:57.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:57.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:58.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:58.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:58.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:58.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:59.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:21:59.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:21:59.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:21:59.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:00.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:00.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:00.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:00.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:01.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:01.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:01.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:01.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:02.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:02.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:02.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:02.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:03.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:03.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:03.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:03.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:04.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:04.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:04.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:04.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:05.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:05.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:05.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:05.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:06.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:06.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:06.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:06.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:07.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:07.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:07.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:07.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:08.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:08.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:08.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:08.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:09.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:09.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:09.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:09.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:10.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:10.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:10.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:10.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:11.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:11.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:11.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:11.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:12.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:12.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:12.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:12.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:13.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:13.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:13.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:13.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:14.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:14.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:14.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:14.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:15.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:15.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:15.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:15.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:16.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:16.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:16.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:16.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:17.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:17.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:17.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:17.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:18.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:18.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:18.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:18.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:19.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:19.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:19.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:19.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:20.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:20.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:20.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:20.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:21.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:21.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:21.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:21.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:22.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:22.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:22.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:22.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:23.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:23.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:23.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:23.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:24.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:24.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:24.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:24.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:25.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:25.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:25.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:25.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:26.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:26.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:26.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:26.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:27.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:27.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:27.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:27.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:28.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:28.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:28.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:28.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:29.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:29.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:29.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:29.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:30.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:30.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:30.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:30.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:31.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:31.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:31.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:31.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:32.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:32.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:32.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:32.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:33.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:33.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:33.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:33.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:34.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:34.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:34.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:34.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:35.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:35.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:35.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:35.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:36.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:36.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:36.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:36.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:37.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:37.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:37.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:37.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:38.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:38.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:38.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:38.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:39.504 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:39.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:39.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:39.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:40.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:40.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:40.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:40.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:41.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:41.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:41.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:41.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:42.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:42.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:42.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:42.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:43.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:43.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:43.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:43.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:44.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:44.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:44.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:44.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:45.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:45.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:45.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:45.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:46.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:46.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:46.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:46.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:47.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:47.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:47.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:47.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:48.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:48.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:48.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:48.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:49.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:49.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:49.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:49.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:50.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:50.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:50.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:50.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:51.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:51.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:51.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:51.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:52.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:52.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:52.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:52.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:53.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:53.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:53.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:53.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:54.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:54.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:54.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:54.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:55.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:55.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:55.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:55.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:56.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:56.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:56.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:56.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:57.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:57.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:57.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:57.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:58.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:58.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:58.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:58.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:59.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:22:59.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:22:59.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:22:59.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:00.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:00.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:00.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:00.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:01.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:01.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:01.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:01.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:02.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:02.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:02.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:02.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:03.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:03.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:03.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:03.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:04.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:04.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:04.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:04.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:05.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:05.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:05.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:05.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:06.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:06.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:06.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:06.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:07.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:07.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:07.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:07.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:08.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:08.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:08.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:08.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:09.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:09.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:09.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:09.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:10.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:10.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:10.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:10.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:11.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:11.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:11.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:11.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:12.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:12.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:12.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:12.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:13.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:13.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:13.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:13.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:14.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:14.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:14.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:14.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:15.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:15.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:15.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:15.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:16.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:16.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:16.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:16.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:17.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:17.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:17.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:17.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:18.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:18.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:18.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:18.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:19.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:19.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:19.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:19.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:20.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:20.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:20.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:20.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:21.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:21.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:21.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:21.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:22.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:22.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:22.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:22.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:23.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:23.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:23.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:23.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:24.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:24.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:24.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:24.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:25.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:25.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:25.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:25.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:26.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:26.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:26.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:26.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:27.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:27.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:27.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:27.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:28.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:28.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:28.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:28.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:29.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:29.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:29.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:29.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:30.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:30.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:30.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:30.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:31.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:31.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:31.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:31.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:32.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:32.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:32.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:32.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:33.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:33.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:33.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:33.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:34.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:34.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:34.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:34.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:35.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:35.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:35.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:35.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:36.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:36.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:36.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:36.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:37.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:37.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:37.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:37.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:38.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:38.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:38.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:38.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:39.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:39.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:39.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:39.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:40.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:40.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:40.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:40.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:41.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:41.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:41.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:41.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:42.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:42.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:42.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:42.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:43.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:43.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:43.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:43.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:44.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:44.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:44.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:44.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:45.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:45.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:45.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:45.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:46.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:46.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:46.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:46.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:47.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:47.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:47.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:47.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:48.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:48.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:48.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:48.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:49.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:49.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:49.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:49.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:50.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:50.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:50.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:50.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:51.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:51.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:51.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:51.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:52.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:52.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:52.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:52.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:53.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:53.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:53.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:53.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:54.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:54.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:54.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:54.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:55.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:55.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:55.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:55.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:56.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:56.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:56.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:56.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:57.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:57.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:57.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:57.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:58.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:58.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:58.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:58.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:59.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:23:59.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:23:59.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:23:59.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:00.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:00.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:00.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:00.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:01.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:01.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:01.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:01.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:02.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:02.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:02.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:02.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:03.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:03.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:03.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:03.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:04.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:04.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:04.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:04.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:05.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:05.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:05.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:05.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:06.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:06.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:06.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:06.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:07.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:07.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:07.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:07.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:08.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:08.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:08.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:08.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:09.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:09.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:09.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:09.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:10.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:10.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:10.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:10.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:11.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:11.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:11.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:11.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:12.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:12.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:12.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:12.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:13.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:13.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:13.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:13.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:14.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:14.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:14.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:14.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:15.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:15.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:15.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:15.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:16.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:16.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:16.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:16.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:17.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:17.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:17.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:17.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:18.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:18.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:18.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:18.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:19.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:19.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:19.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:19.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:20.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:20.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:20.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:20.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:21.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:21.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:21.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:21.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:22.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:22.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:22.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:22.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:23.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:23.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:23.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:23.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:24.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:24.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:24.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:24.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:25.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:25.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:25.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:25.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:26.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:26.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:26.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:26.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:27.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:27.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:27.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:27.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:28.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:28.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:28.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:28.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:29.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:29.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:29.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:29.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:30.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:30.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:30.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:30.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:31.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:31.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:31.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:31.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:32.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:32.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:32.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:32.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:33.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:33.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:33.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:33.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:34.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:34.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:34.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:34.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:35.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:35.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:35.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:35.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:36.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:36.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:36.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:36.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:37.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:37.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:37.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:37.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:38.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:38.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:38.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:38.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:39.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:39.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:39.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:39.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:40.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:40.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:40.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:40.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:41.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:41.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:41.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:41.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:42.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:42.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:42.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:42.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:43.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:43.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:43.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:43.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:44.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:44.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:44.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:44.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:45.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:45.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:45.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:46.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:46.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:46.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:46.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:46.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:47.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:47.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:47.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:47.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:48.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:48.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:48.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:48.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:49.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:49.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:49.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:49.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:50.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:50.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:50.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:50.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:51.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:51.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:51.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:51.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:52.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:52.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:52.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:52.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:53.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:53.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:53.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:53.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:54.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:54.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:54.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:54.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:55.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:55.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:55.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:55.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:56.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:56.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:56.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:56.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:57.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:57.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:57.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:57.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:58.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:58.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:58.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:59.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:59.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:24:59.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:24:59.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:24:59.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:00.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:00.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:00.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:00.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:01.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:01.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:01.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:01.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:02.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:02.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:02.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:02.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:03.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:03.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:03.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:03.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:04.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:04.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:04.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:04.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:05.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:05.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:05.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:05.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:06.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:06.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:06.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:06.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:07.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:07.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:07.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:07.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:08.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:08.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:08.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:09.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:09.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:09.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:09.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:10.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:10.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:10.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:10.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:10.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:11.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:11.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:11.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:12.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:12.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:12.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:12.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:12.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:13.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:13.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:13.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:13.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:14.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:14.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:14.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:14.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:15.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:15.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:15.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:15.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:16.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:16.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:16.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:16.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:17.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:17.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:17.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:17.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:18.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:18.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:18.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:18.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:19.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:19.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:19.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:19.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:20.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:20.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:20.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:20.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:21.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:21.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:21.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:21.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:22.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:22.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:22.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:22.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:23.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:23.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:23.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:23.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:24.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:24.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:24.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:24.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:25.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:25.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:25.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:25.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:26.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:26.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:26.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:26.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:27.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:27.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:27.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:27.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:28.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:28.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:28.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:28.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:29.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:29.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:29.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:29.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:30.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:30.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:30.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:30.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:31.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:31.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:31.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:32.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:32.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:32.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:33.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:33.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:33.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:33.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:33.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:34.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:34.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:34.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:34.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:35.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:35.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:35.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:35.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:36.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:36.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:36.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:36.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:36.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:37.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:37.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:37.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:38.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:38.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:38.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:38.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:38.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:39.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:39.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:39.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:39.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:40.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:40.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:40.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:40.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:41.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:41.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:41.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:42.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:42.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:42.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:42.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:42.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:43.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:43.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:43.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:43.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:44.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:44.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:44.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:44.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:45.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:45.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:45.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:45.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:46.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:46.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:46.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:46.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:47.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:47.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:47.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:47.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:48.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:48.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:48.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:49.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:49.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:49.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:49.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:49.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:50.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:50.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:50.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:50.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:51.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:51.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:51.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:51.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:52.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:52.788+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:52.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:53.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:53.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:53.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:53.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:54.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:54.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:54.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:55.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:55.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:55.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:55.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:56.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:56.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:56.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:56.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:57.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:57.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:57.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:57.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:58.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:58.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:58.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:58.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:58.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:25:59.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:25:59.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:25:59.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:00.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:00.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:00.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:00.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:01.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:01.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:01.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:01.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:02.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:02.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:02.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:02.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:03.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:03.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:03.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:03.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:04.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:04.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:04.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:04.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:05.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:05.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:05.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:05.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:06.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:06.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:06.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:06.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:07.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:07.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:07.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:07.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:08.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:08.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:08.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:08.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:09.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:09.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:09.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:09.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:10.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:10.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:10.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:10.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:11.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:11.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:11.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:11.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:11.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:12.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:12.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:12.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:12.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:13.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:13.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:13.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:13.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:14.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:14.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:14.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:14.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:15.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:15.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:15.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:15.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:15.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:16.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:16.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:16.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:17.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:17.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:17.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:18.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:18.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:18.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:18.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:19.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:19.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:19.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:19.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:20.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:20.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:20.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:20.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:21.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:21.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:21.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:21.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:22.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:22.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:22.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:22.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:23.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:23.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:23.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:23.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:24.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:24.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:24.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:24.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:25.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:25.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:25.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:25.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:26.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:26.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:26.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:26.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:27.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:27.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:27.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:27.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:28.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:28.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:28.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:28.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:29.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:29.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:29.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:29.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:30.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:30.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:30.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:30.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:31.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:31.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:31.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:31.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:32.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:32.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:32.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:32.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:33.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:33.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:33.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:33.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:34.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:34.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:34.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:34.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:35.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:35.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:35.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:35.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:36.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:36.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:36.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:36.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:37.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:37.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:37.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:37.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:38.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:38.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:38.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:38.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:39.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:39.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:39.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:39.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:40.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:40.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:40.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:40.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:41.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:41.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:41.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:41.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:42.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:42.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:42.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:42.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:43.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:43.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:43.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:43.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:44.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:44.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:44.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:44.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:45.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:45.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:45.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:45.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:46.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:46.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:46.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:46.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:47.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:47.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:47.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:47.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:48.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:48.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:48.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:48.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:49.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:49.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:49.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:49.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:49.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:50.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:50.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:50.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:50.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:51.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:51.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:51.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:51.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:51.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:52.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:52.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:52.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:52.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:53.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:53.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:53.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:53.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:54.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:54.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:54.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:54.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:55.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:55.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:55.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:55.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:56.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:56.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:56.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:56.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:57.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:57.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:57.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:57.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:58.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:58.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:58.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:26:58.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:59.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:26:59.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:26:59.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:00.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:00.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:00.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:00.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:01.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:01.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:01.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:02.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:02.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:02.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:02.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:02.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:02.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:03.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:03.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:03.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:04.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:04.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:04.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:04.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:05.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:05.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:05.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:06.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:06.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:06.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:06.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:07.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:07.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:07.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:07.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:07.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:08.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:08.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:08.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:08.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:08.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:09.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:09.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:09.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:09.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:10.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:10.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:10.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:10.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:11.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:11.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:11.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:12.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:12.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:12.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:12.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:12.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:13.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:13.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:13.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:14.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:14.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:14.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:14.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:15.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:15.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:15.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:15.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:16.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:16.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:16.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:16.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:16.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:17.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:17.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:17.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:17.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:18.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:18.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:18.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:18.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:19.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:19.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:19.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:19.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:20.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:20.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:20.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:20.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:21.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:21.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:21.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:21.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:22.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:22.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:22.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:22.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:23.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:23.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:23.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:23.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:24.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:24.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:24.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:24.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:25.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:25.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:25.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:25.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:26.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:26.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:26.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:26.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:27.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:27.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:27.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:27.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:28.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:28.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:28.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:28.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:29.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:29.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:29.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:29.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:30.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:30.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:30.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:30.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:31.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:31.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:31.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:31.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:32.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:32.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:32.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:32.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:33.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:33.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:33.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:33.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:34.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:34.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:34.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:34.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:35.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:35.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:35.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:35.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:36.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:36.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:36.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:36.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:37.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:37.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:37.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:37.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:38.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:38.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:38.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:38.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:39.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:39.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:39.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:39.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:40.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:40.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:40.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:40.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:41.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:41.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:41.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:41.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:42.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:42.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:42.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:42.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:43.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:43.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:43.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:43.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:44.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:44.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:44.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:44.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:45.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:45.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:45.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:45.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:46.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:46.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:46.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:46.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:47.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:47.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:47.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:47.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:48.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:48.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:48.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:48.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:49.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:49.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:49.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:49.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:50.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:50.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:50.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:50.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:51.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:51.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:51.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:51.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:52.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:52.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:52.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:52.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:53.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:53.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:53.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:53.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:54.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:54.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:54.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:54.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:55.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:55.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:55.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:55.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:56.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:56.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:56.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:56.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:57.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:57.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:57.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:57.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:58.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:58.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:58.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:58.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:59.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:27:59.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:27:59.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:27:59.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:00.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:00.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:00.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:00.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:01.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:01.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:01.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:01.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:02.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:02.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:02.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:02.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:03.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:03.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:03.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:03.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:04.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:04.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:04.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:04.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:05.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:05.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:05.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:05.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:06.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:06.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:06.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:06.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:07.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:07.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:07.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:07.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:08.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:08.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:08.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:08.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:09.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:09.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:09.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:09.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:10.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:10.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:10.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:10.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:11.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:11.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:11.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:11.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:12.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:12.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:12.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:12.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:13.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:13.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:13.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:13.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:14.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:14.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:14.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:14.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:15.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:15.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:15.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:15.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:16.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:16.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:16.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:16.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:17.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:17.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:17.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:17.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:18.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:18.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:18.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:18.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:19.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:19.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:19.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:19.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:20.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:20.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:20.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:20.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:21.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:21.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:21.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:21.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:22.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:22.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:22.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:22.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:23.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:23.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:23.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:23.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:24.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:24.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:24.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:24.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:25.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:25.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:25.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:25.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:26.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:26.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:26.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:26.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:27.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:27.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:27.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:27.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:28.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:28.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:28.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:28.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:29.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:29.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:29.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:29.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:30.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:30.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:30.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:30.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:31.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:31.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:31.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:31.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:32.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:32.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:32.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:32.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:33.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:33.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:33.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:33.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:34.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:34.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:34.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:34.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:35.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:35.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:35.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:35.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:36.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:36.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:36.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:36.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:37.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:37.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:37.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:37.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:38.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:38.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:38.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:38.532+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:39.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:39.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:39.498 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:39.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:40.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:40.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:40.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:40.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:41.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:41.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:41.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:41.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:42.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:42.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:42.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:42.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:43.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:43.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:43.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:43.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:44.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:44.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:44.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:44.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:45.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:45.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:45.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:45.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:46.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:46.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:46.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:46.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:47.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:47.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:47.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:47.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:48.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:48.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:48.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:48.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:49.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:49.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:49.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:49.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:50.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:50.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:50.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:50.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:51.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:51.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:51.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:51.611+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:52.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:52.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:52.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:52.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:53.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:53.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:53.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:53.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:54.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:54.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:54.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:54.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:55.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:55.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:55.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:55.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:56.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:56.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:56.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:56.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:57.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:57.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:57.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:57.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:58.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:58.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:58.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:58.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:59.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:28:59.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:28:59.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:28:59.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:00.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:00.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:00.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:00.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:01.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:01.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:01.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:01.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:02.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:02.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:02.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:02.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:03.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:03.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:03.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:03.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:04.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:04.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:04.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:04.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:05.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:05.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:05.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:05.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:06.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:06.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:06.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:06.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:07.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:07.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:07.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:07.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:08.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:08.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:08.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:08.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:09.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:09.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:09.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:09.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:10.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:10.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:10.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:10.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:11.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:11.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:11.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:11.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:12.174 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-23T01:29:12.211+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac14ca60 msgr2=0x7f81ac125eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-23T01:29:12.175 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-23T01:29:12.212+0000 7f81c798a700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6809/96736,v1:172.21.15.37:6811/96736] conn(0x7f81ac125ae0 msgr2=0x7f81ac0ca6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-07-23T01:29:12.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:12.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:12.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:12.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:13.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:13.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:13.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:13.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:14.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:14.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:14.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:14.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:15.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:15.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:15.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:15.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:16.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:16.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:16.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:16.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:17.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:17.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:17.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:17.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:18.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:18.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:18.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:18.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:19.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:19.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:19.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:19.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:20.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:20.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:20.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:20.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:21.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:21.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:21.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:21.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:22.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:22.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:22.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:22.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:23.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:23.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:23.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:23.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:24.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:24.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:24.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:24.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:25.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:25.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:25.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:25.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:26.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:26.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:26.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:26.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:27.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:27.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:27.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:27.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:28.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:28.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:28.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:28.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:29.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:29.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:29.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:29.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:30.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:30.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:30.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:30.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:31.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:31.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:31.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:31.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:32.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:32.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:32.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:32.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:33.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:33.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:33.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:33.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:34.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:34.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:34.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:34.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:35.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:35.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:35.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:35.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:36.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:36.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:36.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:36.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:37.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:37.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:37.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:37.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:38.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:38.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:38.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:38.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:39.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:39.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:39.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:39.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:40.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:40.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:40.861 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:40.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:41.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:41.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:41.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:41.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:42.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:42.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:42.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:42.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:43.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:43.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:43.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:43.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:44.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:44.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:44.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:44.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:45.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:45.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:45.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:45.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:46.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:46.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:46.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:46.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:47.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:47.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:47.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:47.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:48.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:48.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:48.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:48.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:49.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:49.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:49.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:49.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:50.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:50.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:50.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:50.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:51.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:51.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:51.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:51.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:52.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:52.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:52.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:52.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:53.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:53.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:53.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:53.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:54.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:54.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:54.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:54.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:55.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:55.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:55.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:55.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:56.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:56.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:56.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:56.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:57.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:57.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:57.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:57.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:58.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:58.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:58.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:58.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:59.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:29:59.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:29:59.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:29:59.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:00.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:00.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:00.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:00.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:01.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:01.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:01.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:01.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:02.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:02.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:02.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:02.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:03.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:03.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:03.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:03.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:04.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:04.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:04.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:04.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:05.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:05.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:05.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:05.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:06.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:06.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:06.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:06.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:07.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:07.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:07.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:07.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:08.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:08.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:08.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:08.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:09.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:09.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:09.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:09.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:10.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:10.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:10.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:10.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:11.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:11.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:11.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:11.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:12.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:12.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:12.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:12.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:13.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:13.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:13.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:13.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:14.150 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:14.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:14.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:14.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:15.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:15.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:15.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:15.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:16.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:16.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:16.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:16.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:17.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:17.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:17.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:17.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:18.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:18.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:18.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:18.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:19.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:19.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:19.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:19.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:20.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:20.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:20.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:20.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:21.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:21.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:21.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:21.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:22.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:22.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:22.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:22.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:23.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:23.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:23.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:23.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:24.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:24.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:24.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:24.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:25.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:25.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:25.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:25.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:26.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:26.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:26.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:26.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:27.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:27.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:27.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:27.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:28.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:28.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:28.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:28.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:29.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:29.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:29.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:29.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:30.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:30.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:30.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:30.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:31.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:31.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:31.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:31.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:32.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:32.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:32.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:32.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:33.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:33.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:33.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:33.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:34.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:34.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:34.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:34.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:35.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:35.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:35.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:35.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:36.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:36.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:36.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:36.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:37.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:37.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:37.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:37.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:38.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:38.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:38.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:38.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:39.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:39.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:39.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:39.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:40.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:40.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:40.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:40.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:41.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:41.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:41.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:41.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:42.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:42.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:42.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:42.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:43.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:43.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:43.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:43.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:44.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:44.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:44.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:44.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:45.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:45.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:45.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:45.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:46.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:46.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:46.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:46.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:47.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:47.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:47.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:47.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:48.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:48.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:48.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:48.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:49.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:49.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:49.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:49.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:50.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:50.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:50.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:50.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:51.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:51.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:51.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:51.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:52.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:52.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:52.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:52.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:53.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:53.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:53.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:53.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:54.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:54.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:54.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:54.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:55.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:55.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:55.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:55.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:56.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:56.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:56.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:56.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:57.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:57.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:57.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:57.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:58.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:58.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:58.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:58.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:59.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:30:59.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:30:59.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:30:59.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:00.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:00.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:00.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:00.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:01.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:01.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:01.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:01.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:02.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:02.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:02.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:02.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:03.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:03.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:03.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:03.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:04.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:04.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:04.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:04.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:05.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:05.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:05.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:05.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:06.717 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:06.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:06.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:06.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:07.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:07.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:07.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:07.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:08.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:08.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:08.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:08.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:09.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:09.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:09.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:09.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:10.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:10.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:10.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:10.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:11.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:11.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:11.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:11.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 129 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:12.779 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:12.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:12.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:12.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:13.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:13.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:13.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:13.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:14.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:14.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:14.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:14.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:15.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:15.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:15.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:15.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:16.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:16.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:16.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:16.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:17.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:17.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:17.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:17.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:18.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:18.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:18.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:18.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:19.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:19.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:19.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:19.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:20.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:20.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:20.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:20.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:21.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:21.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:21.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:21.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:22.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:22.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:22.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:22.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:23.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:23.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:23.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:23.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:24.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:24.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:24.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:24.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:25.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:25.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:25.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:25.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:26.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:26.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:26.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:26.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:27.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:27.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:27.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:27.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:28.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:28.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:28.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:28.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:29.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:29.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:29.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:29.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:30.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:30.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:30.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:30.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:31.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:31.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:31.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:31.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:32.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:32.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:32.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:32.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:33.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:33.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:33.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:33.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:34.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:34.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:34.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:34.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:35.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:35.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:35.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:35.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:36.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:36.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:36.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:36.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:37.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:37.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:37.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:37.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:38.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:38.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:38.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:38.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:39.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:39.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:39.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:39.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:40.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:40.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:40.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:40.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:41.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:41.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:41.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:41.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 3 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T01:31:42.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:42.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:42.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:42.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:43.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:43.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:43.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:43.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:44.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:44.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:44.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:44.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:45.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:45.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:45.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:45.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:46.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:46.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:46.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:46.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:47.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:47.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:47.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:47.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:48.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:48.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:48.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:48.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:49.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:49.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:49.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:49.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:50.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:50.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:50.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:50.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:51.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:51.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:51.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:51.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:52.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:52.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:52.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:52.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:53.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:53.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:53.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:53.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:54.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:54.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:54.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:54.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:55.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:55.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:55.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:55.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:56.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:56.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:56.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:56.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:57.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:57.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:57.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:57.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:58.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:58.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:58.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:58.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:59.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:31:59.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:31:59.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:31:59.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:00.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:00.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:00.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:00.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:01.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:01.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:01.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:02.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:02.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:02.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:02.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:02.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:03.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:03.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:03.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:04.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:04.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:04.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:05.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:05.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:05.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:05.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:06.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:06.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:06.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:06.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:07.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:07.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:07.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:07.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:08.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:08.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:08.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:08.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:09.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:09.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:09.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:09.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:10.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:10.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:10.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:10.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:11.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:11.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:11.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:11.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:12.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:12.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:12.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:12.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:13.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:13.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:13.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:13.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:14.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:14.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:14.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:14.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:15.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:15.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:15.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:15.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:16.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:16.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:16.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:16.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:16.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:17.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:17.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:17.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:17.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:17.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:18.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:18.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:18.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:18.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:19.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:19.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:19.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:19.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:20.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:20.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:20.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:20.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:21.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:21.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:21.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:21.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:22.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:22.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:22.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:22.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:23.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:23.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:23.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:23.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:24.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:24.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:24.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:24.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:25.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:25.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:25.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:25.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:26.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:26.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:26.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:26.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:27.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:27.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:27.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:27.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:28.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:28.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:28.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:28.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:29.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:29.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:29.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:29.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:30.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:30.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:30.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:30.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:31.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:31.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:31.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:31.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:32.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:32.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:32.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:32.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:33.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:33.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:33.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:33.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:34.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:34.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:34.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:34.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:35.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:35.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:35.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:35.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:36.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:36.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:36.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:36.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:37.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:37.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:37.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:37.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:38.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:38.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:38.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:38.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:39.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:39.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:39.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:39.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:40.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:40.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:40.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:40.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:41.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:41.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:41.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:41.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:42.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:42.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:42.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:42.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:43.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:43.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:43.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:43.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:44.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:44.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:44.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:44.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:45.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:45.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:45.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:45.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:46.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:46.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:46.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:46.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:47.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:47.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:47.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:47.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:48.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:48.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:48.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:48.970+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:49.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:49.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:49.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:49.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:50.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:50.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:50.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:50.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:51.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:51.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:51.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:51.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:52.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:52.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:52.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:52.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:53.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:53.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:53.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:53.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:54.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:54.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:54.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:54.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:55.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:55.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:55.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:55.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:56.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:56.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:56.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:56.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:57.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:57.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:57.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:57.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:58.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:58.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:58.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:58.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:59.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:32:59.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:32:59.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:32:59.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:00.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:00.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:00.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:00.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:01.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:01.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:01.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:01.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:02.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:02.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:02.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:02.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:03.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:03.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:03.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:03.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:04.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:04.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:04.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:04.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:05.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:05.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:05.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:05.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:06.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:06.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:06.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:06.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:07.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:07.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:07.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:07.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:08.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:08.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:08.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:08.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:09.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:09.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:09.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:09.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:10.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:10.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:10.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:10.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:11.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:11.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:11.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:11.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:12.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:12.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:12.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:12.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:13.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:13.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:13.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:13.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:14.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:14.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:14.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:14.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:15.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:15.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:15.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:15.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:16.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:16.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:16.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:16.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:17.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:17.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:17.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:17.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:18.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:18.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:18.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:18.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:19.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:19.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:19.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:19.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:20.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:20.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:20.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:20.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:21.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:21.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:21.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:21.728+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:22.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:22.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:22.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:22.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:23.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:23.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:23.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:23.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:24.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:24.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:24.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:24.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:25.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:25.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:25.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:25.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:26.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:26.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:26.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:26.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:27.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:27.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:27.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:27.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:28.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:28.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:28.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:28.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:29.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:29.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:29.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:29.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:30.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:30.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:30.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:30.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:31.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:31.495+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:31.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:31.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:32.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:32.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:32.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:32.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:33.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:33.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:33.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:33.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:34.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:34.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:34.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:34.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:35.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:35.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:35.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:35.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:36.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:36.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:36.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:36.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:37.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:37.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:37.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:37.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:38.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:38.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:38.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:38.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:39.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:39.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:39.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:39.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:40.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:40.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:40.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:40.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:41.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:41.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:41.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:41.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:42.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:42.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:42.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:42.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:43.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:43.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:43.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:43.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:44.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:44.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:44.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:44.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:45.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:45.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:45.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:45.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:46.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:46.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:46.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:46.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:47.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:47.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:47.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:47.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:48.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:48.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:48.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:48.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:49.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:49.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:49.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:49.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:50.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:50.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:50.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:50.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:51.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:51.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:51.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:51.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:52.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:52.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:52.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:52.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:53.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:53.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:53.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:53.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:54.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:54.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:54.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:54.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:55.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:55.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:55.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:55.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:56.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:56.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:56.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:56.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:57.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:57.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:57.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:57.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:58.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:58.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:58.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:58.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:59.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:33:59.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:33:59.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:33:59.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:00.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:00.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:00.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:00.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:01.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:01.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:01.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:01.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:02.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:02.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:02.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:02.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:03.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:03.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:03.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:03.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:04.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:04.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:04.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:04.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:05.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:05.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:05.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:05.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:06.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:06.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:06.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:06.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:07.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:07.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:07.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:07.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:08.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:08.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:08.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:08.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:09.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:09.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:09.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:09.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:09.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:10.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:10.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:10.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:10.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:11.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:11.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:11.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:11.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:12.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:12.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:12.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:13.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:13.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:13.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:13.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:13.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:14.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:14.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:14.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:14.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:15.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:15.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:15.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:16.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:16.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:16.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:16.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:17.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:17.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:17.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:17.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:18.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:18.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:18.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:18.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:19.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:19.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:19.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:19.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:20.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:20.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:20.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:20.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:20.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:21.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:21.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:21.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:21.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:22.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:22.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:22.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:23.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:23.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:23.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:23.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:23.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:24.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:24.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:24.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:25.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:25.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:25.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:25.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:26.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:26.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:26.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:26.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:27.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:27.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:27.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:27.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:28.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:28.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:28.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:28.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:29.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:29.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:29.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:29.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:30.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:30.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:30.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:30.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:31.151 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:31.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:31.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:31.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:32.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:32.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:32.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:32.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:33.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:33.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:33.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:33.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:34.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:34.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:34.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:34.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:35.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:35.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:35.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:35.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:36.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:36.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:36.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:36.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:37.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:37.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:37.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:37.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:38.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:38.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:38.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:38.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:39.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:39.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:39.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:39.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:40.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:40.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:40.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:40.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:41.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:41.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:41.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:41.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:42.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:42.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:42.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:42.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:43.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:43.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:43.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:43.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:44.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:44.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:44.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:44.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:45.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:45.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:45.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:45.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:46.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:46.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:46.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:46.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:47.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:47.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:47.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:47.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:48.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:48.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:48.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:48.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:49.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:49.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:49.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:49.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:50.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:50.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:50.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:50.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:51.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:51.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:51.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:51.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:52.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:52.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:52.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:52.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:53.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:53.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:53.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:53.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:54.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:54.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:54.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:54.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:55.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:55.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:55.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:55.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:56.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:56.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:56.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:56.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:57.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:57.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:57.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:57.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:58.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:58.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:58.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:58.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:59.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:34:59.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:34:59.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:34:59.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:00.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:00.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:00.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:00.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:01.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:01.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:01.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:01.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:02.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:02.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:02.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:02.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:03.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:03.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:03.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:03.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:04.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:04.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:04.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:04.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:05.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:05.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:05.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:05.671+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:06.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:06.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:06.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:06.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:07.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:07.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:07.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:07.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:08.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:08.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:08.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:08.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:09.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:09.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:09.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:09.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:10.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:10.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:10.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:10.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:11.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:11.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:11.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:11.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:12.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:12.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:12.815 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:12.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:13.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:13.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:13.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:13.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:14.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:14.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:14.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:14.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:15.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:15.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:15.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:15.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:16.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:16.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:16.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:16.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:17.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:17.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:17.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:17.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:18.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:18.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:18.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:18.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:19.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:19.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:19.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:19.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:20.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:20.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:20.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:20.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:21.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:21.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:21.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:21.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:22.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:22.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:22.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:22.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:23.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:23.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:23.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:23.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:24.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:24.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:24.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:24.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:25.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:25.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:25.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:25.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:25.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:26.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:26.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:26.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:26.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:26.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:27.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:27.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:27.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:27.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:28.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:28.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:28.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:28.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:29.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:29.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:29.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:30.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:30.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:30.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:31.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:31.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:31.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:31.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:32.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:32.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:32.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:32.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:32.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:33.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:33.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:33.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:34.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:34.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:34.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:34.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:35.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:35.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:35.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:35.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:35.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:36.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:36.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:36.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:36.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:37.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:37.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:37.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:37.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:37.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:38.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:38.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:38.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:38.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:39.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:39.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:39.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:39.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:40.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:40.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:40.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:40.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:41.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:41.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:41.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:41.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:42.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:42.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:42.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:43.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:43.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:43.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:44.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:44.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:44.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:44.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:44.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:45.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:45.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:45.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:45.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:45.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:46.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:46.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:46.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:46.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:47.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:47.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:47.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:47.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:48.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:48.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:48.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:48.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:49.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:49.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:49.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:49.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:50.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:50.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:50.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:50.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:51.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:51.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:51.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:51.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:52.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:52.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:52.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:52.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:53.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:53.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:53.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:53.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:54.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:54.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:54.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:54.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:55.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:55.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:55.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:55.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:56.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:56.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:56.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:56.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:57.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:57.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:57.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:57.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:58.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:58.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:58.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:58.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:59.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:35:59.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:35:59.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:35:59.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:00.843 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:00.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:00.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:00.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:01.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:01.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:01.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:01.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:02.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:02.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:02.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:02.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:03.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:03.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:03.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:03.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:04.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:04.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:04.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:04.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:05.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:05.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:05.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:05.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:06.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:06.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:06.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:06.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:07.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:07.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:07.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:07.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:08.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:08.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:08.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:09.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:09.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:09.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:09.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:10.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:10.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:10.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:10.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:11.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:11.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:11.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:11.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:12.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:12.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:12.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:12.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:12.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:13.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:13.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:13.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:14.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:14.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:14.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:14.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:14.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:15.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:15.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:15.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:15.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:16.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:16.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:16.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:17.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:17.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:17.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:17.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:18.003+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:18.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:18.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:18.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:18.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:19.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:19.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:19.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:19.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:20.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:20.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:20.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:20.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:21.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:21.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:21.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:21.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:22.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:22.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:22.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:22.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:23.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:23.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:23.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:23.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:24.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:24.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:24.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:24.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:25.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:25.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:25.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:25.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:26.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:26.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:26.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:26.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:27.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:27.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:27.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:27.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:28.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:28.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:28.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:29.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:29.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:29.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:29.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:29.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:30.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:30.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:30.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:31.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:31.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:31.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:31.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:31.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:32.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:32.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:32.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:33.026+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:33.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:33.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:34.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:34.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:34.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:34.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:35.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:35.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:35.656 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:35.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:36.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:36.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:36.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:36.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:37.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:37.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:37.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:37.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:38.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:38.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:38.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:38.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:39.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:39.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:39.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:39.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:40.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:40.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:40.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:40.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:41.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:41.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:41.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:41.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:42.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:42.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:42.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:42.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:43.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:43.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:43.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:43.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:44.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:44.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:44.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:44.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:45.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:45.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:45.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:45.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:46.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:46.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:46.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:46.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:47.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:47.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:47.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:47.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:47.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:48.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:48.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:48.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:49.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:49.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:49.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:49.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:50.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:50.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:50.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:50.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:51.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:51.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:51.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:51.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:52.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:52.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:52.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:52.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:53.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:53.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:53.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:53.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:54.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:54.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:54.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:54.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:55.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:55.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:55.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:55.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:56.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:56.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:56.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:56.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:57.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:57.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:57.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:57.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:58.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:58.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:58.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:58.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:59.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:36:59.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:36:59.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:36:59.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:00.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:00.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:00.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:00.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:01.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:01.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:01.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:01.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:02.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:02.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:02.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:02.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:03.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:03.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:03.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:03.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:04.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:04.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:04.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:04.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:05.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:05.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:05.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:05.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:06.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:06.189+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:06.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:06.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:07.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:07.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:07.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:07.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:08.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:08.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:08.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:08.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:09.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:09.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:09.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:09.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:10.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:10.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:10.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:10.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:11.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:11.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:11.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:11.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:12.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:12.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:12.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:12.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:13.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:13.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:13.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:13.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:14.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:14.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:14.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:14.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:15.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:15.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:15.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:15.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:16.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:16.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:16.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:16.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:17.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:17.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:17.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:17.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:18.090 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:18.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:18.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:18.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:19.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:19.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:19.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:19.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:20.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:20.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:20.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:20.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:21.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:21.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:21.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:21.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:22.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:22.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:22.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:22.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:23.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:23.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:23.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:23.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:24.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:24.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:24.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:24.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:25.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:25.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:25.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:25.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:26.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:26.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:26.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:26.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:27.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:27.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:27.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:27.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:28.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:28.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:28.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:28.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:29.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:29.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:29.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:29.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:30.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:30.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:30.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:31.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:31.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:31.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:31.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:31.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:32.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:32.147+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:32.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:32.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:33.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:33.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:33.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:33.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:34.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:34.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:34.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:34.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:35.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:35.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:35.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:35.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:36.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:36.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:36.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:36.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:37.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:37.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:37.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:37.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:37.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:38.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:38.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:38.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:38.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:39.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:39.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:39.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:39.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:40.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:40.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:40.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:40.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:41.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:41.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:41.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:41.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:42.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:42.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:42.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:42.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:43.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:43.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:43.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:43.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:43.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:44.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:44.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:44.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:44.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:45.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:45.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:45.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:45.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:46.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:46.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:46.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:46.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:47.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:47.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:47.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:47.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:48.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:48.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:48.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:48.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:49.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:49.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:49.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:49.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:50.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:50.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:50.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:50.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:51.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:51.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:51.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:51.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:52.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:52.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:52.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:52.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:53.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:53.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:53.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:53.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:54.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:54.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:54.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:54.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:55.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:55.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:55.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:55.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:56.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:56.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:56.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:56.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:57.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:57.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:57.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:57.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:58.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:58.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:58.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:58.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:59.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:37:59.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:37:59.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:37:59.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:00.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:00.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:00.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:00.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:01.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:01.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:01.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:01.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:02.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:02.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:02.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:02.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:03.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:03.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:03.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:03.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:04.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:04.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:04.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:04.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:05.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:05.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:05.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:05.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:06.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:06.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:06.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:06.898+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:07.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:07.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:07.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:07.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:08.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:08.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:08.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:08.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:09.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:09.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:09.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:09.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:10.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:10.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:10.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:10.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:11.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:11.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:11.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:11.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:12.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:12.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:12.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:12.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:13.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:13.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:13.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:13.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:14.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:14.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:14.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:14.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:15.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:15.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:15.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:15.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:16.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:16.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:16.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:16.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:17.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:17.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:17.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:17.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:18.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:18.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:18.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:18.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:19.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:19.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:19.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:19.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:20.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:20.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:20.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:20.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:21.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:21.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:21.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:21.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:22.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:22.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:22.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:22.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:23.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:23.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:23.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:23.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:24.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:24.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:24.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:24.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:25.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:25.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:25.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:25.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:26.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:26.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:26.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:26.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:27.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:27.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:27.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:27.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:28.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:28.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:28.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:28.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:29.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:29.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:29.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:29.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:30.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:30.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:30.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:30.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:31.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:31.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:31.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:31.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:32.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:32.705+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:32.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:32.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:33.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:33.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:33.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:33.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:34.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:34.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:34.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:34.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:35.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:35.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:35.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:35.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:36.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:36.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:36.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:36.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:37.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:37.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:37.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:37.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:38.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:38.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:38.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:38.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:39.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:39.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:39.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:39.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:40.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:40.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:40.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:40.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:41.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:41.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:41.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:41.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:42.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:42.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:42.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:42.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:43.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:43.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:43.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:43.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:44.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:44.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:44.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:44.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:45.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:45.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:45.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:45.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:46.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:46.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:46.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:46.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:47.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:47.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:47.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:47.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:48.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:48.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:48.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:48.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:49.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:49.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:49.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:49.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:50.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:50.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:50.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:50.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:51.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:51.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:51.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:51.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:52.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:52.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:52.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:52.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:53.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:53.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:53.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:53.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:54.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:54.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:54.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:54.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:55.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:55.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:55.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:55.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:56.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:56.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:56.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:56.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:57.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:57.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:57.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:57.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:58.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:58.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:58.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:58.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:59.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:38:59.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:38:59.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:38:59.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:00.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:00.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:00.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:00.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:01.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:01.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:01.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:01.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:02.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:02.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:02.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:02.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:03.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:03.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:03.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:03.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:04.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:04.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:04.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:04.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:05.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:05.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:05.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:05.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:06.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:06.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:06.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:06.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:07.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:07.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:07.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:07.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:08.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:08.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:08.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:08.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:09.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:09.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:09.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:09.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:10.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:10.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:10.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:10.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:11.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:11.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:11.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:11.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:12.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:12.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:12.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:12.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:13.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:13.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:13.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:13.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:14.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:14.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:14.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:14.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:15.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:15.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:15.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:15.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:16.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:16.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:16.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:16.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:17.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:17.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:17.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:17.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:18.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:18.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:18.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:18.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:19.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:19.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:19.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:19.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:20.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:20.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:20.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:20.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:21.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:21.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:21.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:21.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:22.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:22.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:22.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:22.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:23.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:23.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:23.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:23.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:24.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:24.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:24.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:24.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:25.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:25.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:25.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:25.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:26.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:26.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:26.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:26.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:27.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:27.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:27.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:27.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:28.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:28.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:28.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:28.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:29.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:29.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:29.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:29.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:30.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:30.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:30.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:30.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:31.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:31.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:31.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:31.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:32.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:32.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:32.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:32.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:33.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:33.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:33.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:33.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:34.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:34.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:34.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:34.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:35.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:35.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:35.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:35.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:36.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:36.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:36.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:36.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:37.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:37.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:37.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:37.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:38.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:38.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:38.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:38.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:39.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:39.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:39.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:39.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:40.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:40.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:40.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:40.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:41.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:41.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:41.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:41.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:42.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:42.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:42.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:42.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:43.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:43.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:43.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:43.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:44.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:44.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:44.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:44.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:45.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:45.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:45.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:45.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:46.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:46.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:46.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:46.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:47.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:47.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:47.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:47.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:48.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:48.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:48.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:48.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:49.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:49.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:49.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:49.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:50.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:50.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:50.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:50.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:51.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:51.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:51.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:51.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:52.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:52.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:52.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:52.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:53.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:53.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:53.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:53.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:54.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:54.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:54.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:54.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:55.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:55.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:55.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:55.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:56.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:56.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:56.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:56.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:57.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:57.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:57.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:57.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:58.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:58.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:58.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:58.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:59.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:39:59.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:39:59.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:39:59.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:00.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:00.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:00.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:00.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:01.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:01.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:01.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:01.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:02.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:02.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:02.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:02.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:03.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:03.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:03.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:03.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:04.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:04.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:04.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:04.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:05.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:05.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:05.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:05.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:06.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:06.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:06.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:06.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:07.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:07.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:07.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:07.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:08.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:08.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:08.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:08.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:09.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:09.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:09.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:09.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:10.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:10.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:10.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:10.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:11.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:11.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:11.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:11.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:12.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:12.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:12.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:12.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:13.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:13.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:13.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:13.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:14.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:14.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:14.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:14.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:15.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:15.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:15.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:15.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:16.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:16.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:16.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:16.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:17.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:17.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:17.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:17.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:18.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:18.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:18.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:18.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:19.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:19.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:19.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:19.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:20.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:20.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:20.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:20.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:21.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:21.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:21.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:21.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:22.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:22.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:22.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:22.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:23.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:23.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:23.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:23.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:24.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:24.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:24.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:24.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:25.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:25.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:25.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:25.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:26.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:26.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:26.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:26.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:27.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:27.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:27.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:27.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:28.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:28.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:28.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:28.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:29.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:29.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:29.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:29.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:30.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:30.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:30.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:30.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:31.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:31.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:31.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:31.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:32.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:32.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:32.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:32.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:33.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:33.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:33.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:33.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:34.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:34.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:34.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:34.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:35.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:35.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:35.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:35.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:36.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:36.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:36.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:36.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:37.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:37.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:37.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:37.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:38.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:38.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:38.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:38.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:39.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:39.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:39.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:39.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:40.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:40.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:40.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:40.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:41.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:41.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:41.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:41.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:42.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:42.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:42.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:42.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:43.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:43.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:43.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:43.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:44.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:44.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:44.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:44.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:45.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:45.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:45.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:45.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:46.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:46.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:46.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:46.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:47.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:47.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:47.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:47.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:48.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:48.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:48.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:48.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:49.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:49.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:49.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:49.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:50.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:50.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:50.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:50.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:51.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:51.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:51.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:51.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:52.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:52.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:52.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:52.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:53.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:53.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:53.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:53.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:54.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:54.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:54.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:54.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:55.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:55.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:55.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:55.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:56.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:56.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:56.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:56.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:57.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:57.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:57.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:57.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:58.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:58.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:58.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:58.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:59.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:40:59.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:40:59.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:40:59.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:00.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:00.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:00.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:00.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:01.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:01.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:01.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:01.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:02.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:02.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:02.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:02.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:03.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:03.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:03.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:03.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:04.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:04.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:04.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:04.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:05.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:05.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:05.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:05.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:06.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:06.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:06.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:06.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:07.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:07.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:07.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:07.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:08.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:08.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:08.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:08.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:09.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:09.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:09.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:09.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:10.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:10.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:10.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:10.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:11.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:11.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:11.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:11.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:12.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:12.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:12.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:12.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:13.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:13.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:13.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:13.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:14.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:14.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:14.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:14.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:15.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:15.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:15.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:15.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:16.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:16.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:16.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:16.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:17.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:17.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:17.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:17.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:18.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:18.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:18.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:18.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:19.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:19.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:19.677 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:19.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:20.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:20.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:20.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:20.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:21.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:21.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:21.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:21.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:22.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:22.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:22.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:22.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:23.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:23.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:23.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:23.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:24.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:24.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:24.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:24.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:25.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:25.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:25.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:25.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:26.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:26.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:26.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:26.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:27.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:27.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:27.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:27.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:28.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:28.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:28.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:28.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:29.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:29.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:29.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:29.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:30.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:30.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:30.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:30.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:31.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:31.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:31.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:31.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:32.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:32.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:32.714 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:32.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:33.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:33.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:33.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:33.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:34.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:34.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:34.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:34.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:35.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:35.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:35.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:35.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:36.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:36.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:36.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:36.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:37.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:37.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:37.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:37.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:38.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:38.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:38.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:38.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:39.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:39.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:39.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:39.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:40.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:40.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:40.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:40.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:41.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:41.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:41.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:41.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:42.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:42.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:42.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:42.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:43.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:43.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:43.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:43.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:44.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:44.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:44.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:44.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:45.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:45.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:45.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:45.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:46.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:46.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:46.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:46.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:47.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:47.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:47.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:47.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:48.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:48.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:48.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:48.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:49.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:49.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:49.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:49.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:50.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:50.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:50.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:50.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:51.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:51.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:51.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:51.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:52.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:52.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:52.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:52.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:53.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:53.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:53.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:53.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:54.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:54.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:54.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:54.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:55.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:55.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:55.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:55.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:56.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:56.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:56.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:56.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:57.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:57.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:57.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:57.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:58.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:58.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:58.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:58.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:59.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:41:59.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:41:59.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:41:59.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:00.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:00.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:00.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:00.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:01.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:01.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:01.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:01.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:02.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:02.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:02.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:02.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:03.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:03.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:03.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:03.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:04.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:04.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:04.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:04.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:05.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:05.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:05.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:05.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:06.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:06.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:06.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:06.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:07.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:07.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:07.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:07.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:08.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:08.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:08.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:08.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:09.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:09.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:09.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:09.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:10.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:10.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:10.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:10.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:11.309 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:11.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:11.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:11.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:12.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:12.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:12.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:12.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:13.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:13.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:13.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:13.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:14.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:14.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:14.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:14.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:15.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:15.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:15.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:15.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:16.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:16.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:16.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:16.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:17.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:17.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:17.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:17.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:18.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:18.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:18.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:18.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:19.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:19.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:19.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:19.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:20.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:20.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:20.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:20.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:21.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:21.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:21.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:21.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:22.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:22.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:22.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:22.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:23.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:23.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:23.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:23.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:24.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:24.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:24.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:24.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:25.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:25.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:25.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:25.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:26.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:26.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:26.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:26.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:27.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:27.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:27.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:27.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:28.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:28.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:28.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:28.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:29.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:29.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:29.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:29.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:30.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:30.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:30.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:30.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:31.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:31.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:31.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:31.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:32.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:32.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:32.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:32.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:33.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:33.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:33.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:33.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:34.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:34.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:34.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:34.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:35.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:35.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:35.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:35.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:36.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:36.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:36.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:36.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:37.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:37.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:37.502 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:37.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:38.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:38.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:38.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:38.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:39.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:39.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:39.517 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:39.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:40.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:40.231+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:40.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:40.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:41.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:41.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:41.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:41.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:42.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:42.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:42.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:42.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:43.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:43.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:43.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:43.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:44.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:44.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:44.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:44.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:45.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:45.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:45.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:45.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:46.219 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:46.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:46.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:46.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:47.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:47.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:47.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:47.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:48.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:48.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:48.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:48.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:49.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:49.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:49.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:49.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:50.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:50.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:50.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:50.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:51.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:51.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:51.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:51.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:52.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:52.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:52.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:52.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:53.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:53.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:53.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:53.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:54.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:54.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:54.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:54.504+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:55.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:55.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:55.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:55.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:56.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:56.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:56.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:56.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:57.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:57.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:57.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:57.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:58.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:58.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:58.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:58.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:59.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:42:59.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:42:59.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:42:59.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:00.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:00.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:00.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:00.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:01.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:01.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:01.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:01.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:02.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:02.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:02.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:02.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:03.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:03.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:03.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:03.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:04.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:04.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:04.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:04.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:05.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:05.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:05.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:05.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:06.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:06.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:06.370 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:06.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:07.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:07.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:07.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:07.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:08.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:08.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:08.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:08.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:09.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:09.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:09.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:09.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:10.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:10.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:10.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:10.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:11.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:11.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:11.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:11.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:12.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:12.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:12.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:12.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:13.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:13.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:13.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:13.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:14.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:14.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:14.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:14.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:15.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:15.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:15.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:15.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:16.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:16.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:16.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:16.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:17.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:17.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:17.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:17.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:18.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:18.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:18.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:18.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:19.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:19.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:19.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:19.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:20.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:20.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:20.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:20.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:21.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:21.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:21.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:21.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:22.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:22.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:22.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:22.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:23.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:23.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:23.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:23.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:24.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:24.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:24.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:24.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:25.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:25.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:25.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:25.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:26.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:26.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:26.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:26.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:27.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:27.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:27.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:27.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:28.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:28.209+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:28.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:28.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:29.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:29.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:29.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:29.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:30.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:30.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:30.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:30.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:31.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:31.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:31.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:31.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:32.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:32.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:32.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:32.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:33.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:33.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:33.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:33.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:34.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:34.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:34.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:34.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:35.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:35.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:35.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:35.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:36.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:36.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:36.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:36.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:37.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:37.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:37.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:37.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:38.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:38.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:38.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:38.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:39.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:39.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:39.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:39.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:40.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:40.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:40.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:40.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:41.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:41.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:41.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:41.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:42.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:42.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:42.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:42.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:43.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:43.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:43.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:43.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:44.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:44.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:44.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:44.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:45.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:45.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:45.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:45.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:46.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:46.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:46.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:46.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:47.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:47.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:47.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:47.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:48.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:48.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:48.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:48.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:49.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:49.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:49.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:49.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:50.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:50.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:50.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:50.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:51.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:51.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:51.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:51.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:52.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:52.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:52.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:52.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:53.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:53.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:53.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:53.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:54.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:54.274+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:54.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:54.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:55.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:55.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:55.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:55.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:56.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:56.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:56.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:56.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:57.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:57.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:57.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:57.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:58.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:58.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:58.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:58.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:59.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:43:59.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:43:59.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:43:59.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:00.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:00.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:00.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:00.472+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:01.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:01.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:01.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:01.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:02.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:02.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:02.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:02.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:03.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:03.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:03.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:03.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:04.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:04.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:04.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:04.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:05.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:05.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:05.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:05.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:06.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:06.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:06.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:06.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:07.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:07.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:07.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:07.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:08.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:08.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:08.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:08.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:09.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:09.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:09.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:09.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:10.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:10.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:10.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:10.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:11.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:11.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:11.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:11.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:12.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:12.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:12.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:12.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:13.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:13.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:13.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:13.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:14.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:14.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:14.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:14.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:15.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:15.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:15.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:15.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:16.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:16.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:16.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:16.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:17.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:17.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:17.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:17.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:18.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:18.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:18.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:18.519+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:19.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:19.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:19.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:19.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:20.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:20.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:20.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:20.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:21.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:21.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:21.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:21.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:22.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:22.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:22.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:22.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:23.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:23.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:23.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:23.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:24.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:24.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:24.481 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:24.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:25.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:25.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:25.456 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:25.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:26.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:26.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:26.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:26.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:27.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:27.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:27.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:27.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:28.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:28.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:28.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:28.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:29.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:29.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:29.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:29.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:30.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:30.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:30.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:30.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:31.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:31.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:31.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:31.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:32.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:32.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:32.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:32.490+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:33.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:33.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:33.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:33.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:34.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:34.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:34.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:34.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:35.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:35.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:35.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:35.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:36.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:36.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:36.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:36.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:37.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:37.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:37.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:37.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:38.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:38.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:38.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:38.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:39.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:39.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:39.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:39.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:40.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:40.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:40.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:40.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:41.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:41.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:41.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:41.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:42.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:42.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:42.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:42.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:43.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:43.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:43.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:43.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:44.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:44.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:44.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:44.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:45.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:45.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:45.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:45.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:46.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:46.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:46.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:46.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:47.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:47.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:47.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:47.471+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:48.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:48.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:48.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:48.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:49.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:49.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:49.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:49.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:50.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:50.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:50.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:50.453+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:51.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:51.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:51.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:51.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:52.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:52.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:52.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:52.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:53.300 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:53.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:53.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:53.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:54.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:54.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:54.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:54.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:55.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:55.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:55.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:55.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:56.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:56.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:56.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:56.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:57.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:57.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:57.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:57.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:58.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:58.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:58.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:58.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:59.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:44:59.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:44:59.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:44:59.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:00.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:00.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:00.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:00.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:01.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:01.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:01.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:01.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:02.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:02.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:02.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:02.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:03.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:03.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:03.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:03.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:04.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:04.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:04.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:04.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:05.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:05.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:05.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:05.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:06.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:06.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:06.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:06.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:07.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:07.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:07.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:07.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:08.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:08.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:08.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:08.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:09.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:09.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:09.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:09.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:10.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:10.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:10.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:10.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:11.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:11.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:11.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:11.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:12.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:12.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:12.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:12.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:13.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:13.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:13.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:13.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:14.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:14.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:14.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:14.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:15.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:15.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:15.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:15.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:16.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:16.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:16.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:16.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:17.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:17.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:17.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:17.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:18.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:18.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:18.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:18.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:19.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:19.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:19.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:19.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:20.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:20.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:20.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:20.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:21.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:21.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:21.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:21.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:22.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:22.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:22.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:22.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:23.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:23.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:23.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:23.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:24.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:24.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:24.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:24.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:25.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:25.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:25.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:25.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:26.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:26.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:26.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:26.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:27.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:27.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:27.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:27.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:28.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:28.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:28.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:28.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:29.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:29.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:29.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:29.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:30.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:30.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:30.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:30.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:31.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:31.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:31.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:31.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:32.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:32.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:32.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:32.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:33.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:33.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:33.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:33.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:34.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:34.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:34.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:34.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:35.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:35.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:35.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:35.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:36.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:36.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:36.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:36.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:37.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:37.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:37.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:37.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:38.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:38.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:38.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:38.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:39.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:39.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:39.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:39.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:40.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:40.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:40.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:40.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:41.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:41.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:41.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:41.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:42.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:42.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:42.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:42.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:43.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:43.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:43.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:43.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:44.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:44.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:44.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:44.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:45.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:45.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:45.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:45.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:46.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:46.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:46.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:46.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:47.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:47.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:47.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:47.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:48.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:48.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:48.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:48.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:49.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:49.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:49.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:49.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:50.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:50.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:50.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:50.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:51.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:51.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:51.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:51.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:52.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:52.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:52.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:52.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:53.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:53.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:53.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:53.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:54.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:54.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:54.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:54.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:55.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:55.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:55.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:55.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:56.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:56.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:56.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:56.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:57.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:57.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:57.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:57.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:58.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:58.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:58.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:58.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:59.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:45:59.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:45:59.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:45:59.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:00.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:00.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:00.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:00.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:01.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:01.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:01.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:01.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:02.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:02.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:02.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:02.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:03.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:03.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:03.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:03.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:04.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:04.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:04.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:04.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:05.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:05.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:05.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:05.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:06.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:06.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:06.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:06.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:07.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:07.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:07.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:07.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:08.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:08.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:08.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:08.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:09.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:09.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:09.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:09.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:10.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:10.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:10.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:10.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:11.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:11.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 132 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:11.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:11.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:12.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:12.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:12.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:12.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:13.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:13.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:13.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:13.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:14.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:14.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:14.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:14.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:15.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:15.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:15.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:15.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:16.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:16.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:16.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:16.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:17.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:17.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:17.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:17.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:18.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:18.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:18.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:18.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:19.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:19.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:19.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:19.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:20.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:20.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:20.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:20.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:21.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:21.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:21.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:21.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:22.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:22.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:22.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:22.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:23.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:23.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:23.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:23.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:24.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:24.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:24.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:24.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:25.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:25.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:25.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:25.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:26.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:26.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:26.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:26.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:27.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:27.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:27.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:27.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:28.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:28.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:28.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:28.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:29.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:29.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:29.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:29.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:30.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:30.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:30.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:30.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:31.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:31.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:31.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:31.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:32.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:32.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:32.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:32.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:33.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:33.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:33.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:33.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:34.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:34.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:34.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:34.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:35.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:35.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:35.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:35.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:36.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:36.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:36.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:36.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:37.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:37.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:37.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:37.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:38.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:38.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:38.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:38.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:39.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:39.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:39.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:39.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:40.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:40.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:40.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:40.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:41.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:41.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:41.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:41.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:42.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:42.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 76 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:42.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:42.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:43.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:43.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:43.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:43.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:44.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:44.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:44.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:44.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:45.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:45.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:45.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:45.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:46.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:46.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:46.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:46.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:47.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:47.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:47.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:47.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:48.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:48.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:48.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:48.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:49.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:49.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:49.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:49.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:50.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:50.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:50.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:50.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:51.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:51.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:51.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:51.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:52.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:52.071+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:52.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:52.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:53.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:53.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:53.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:53.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:54.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:54.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:54.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:54.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:55.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:55.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:55.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:55.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:56.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:56.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:56.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:56.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:57.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:57.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:57.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:57.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:58.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:58.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:58.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:58.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:59.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:46:59.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:46:59.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:46:59.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:00.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:00.146+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:00.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:00.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:01.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:01.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:01.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:01.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:02.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:02.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:02.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:02.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:03.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:03.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:03.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:03.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:04.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:04.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:04.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:04.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:05.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:05.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:05.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:05.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:06.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:06.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:06.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:06.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:07.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:07.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:07.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:07.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:08.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:08.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:08.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:08.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:09.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:09.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:09.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:09.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:10.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:10.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:10.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:10.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:11.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:11.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:11.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:11.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:12.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:12.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:12.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:12.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:13.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:13.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:13.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:13.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:14.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:14.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:14.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:14.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:15.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:15.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:15.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:15.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:16.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:16.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:16.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:16.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:17.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:17.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:17.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:17.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:18.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:18.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:18.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:18.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:19.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:19.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:19.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:19.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:20.026 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:20.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:20.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:20.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:21.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:21.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:21.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:21.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:22.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:22.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:22.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:22.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:23.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:23.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:23.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:23.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:24.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:24.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:24.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:24.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:25.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:25.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:25.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:25.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:26.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:26.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:26.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:26.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:26.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:27.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:27.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:27.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:27.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:28.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:28.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:28.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:28.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:28.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:29.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:29.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:29.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:29.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:30.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:30.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:30.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:30.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:31.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:31.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:31.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:31.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:32.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:32.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:32.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:32.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:33.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:33.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:33.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:33.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:34.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:34.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:34.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:35.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:35.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:35.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:35.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:36.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:36.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:36.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:36.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:37.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:37.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:37.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:37.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:37.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:38.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:38.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:38.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:38.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:39.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:39.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:39.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:39.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:40.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:40.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:41.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:41.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:41.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:41.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:42.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:42.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:42.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:42.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:43.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:43.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:43.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:43.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:44.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:44.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:44.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:44.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:45.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:45.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:45.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:45.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:46.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:46.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:46.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:46.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:47.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:47.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:47.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:47.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:48.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:48.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:48.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:48.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:49.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:49.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:49.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:49.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:50.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:50.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:50.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:50.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:51.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:51.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:51.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:51.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:52.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:52.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:52.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:52.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:53.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:53.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:53.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:53.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:54.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:54.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:54.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:54.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:55.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:55.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:55.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:55.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:56.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:56.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:56.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:56.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:57.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:57.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:57.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:57.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:58.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:58.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:58.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:58.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:59.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:47:59.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:47:59.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:47:59.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:00.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:00.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:00.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:00.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:01.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:01.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:01.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:01.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:02.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:02.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:02.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:02.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:03.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:03.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:03.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:03.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:04.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:04.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:04.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:04.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:05.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:05.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:05.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:05.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:06.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:06.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:06.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:06.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:07.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:07.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:07.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:07.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:08.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:08.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:08.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:08.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:09.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:09.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:09.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:09.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:10.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:10.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:10.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:10.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:11.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:11.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:11.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:11.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:12.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:12.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:12.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:12.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:13.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:13.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:13.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:13.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:14.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:14.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:14.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:14.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:15.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:15.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:15.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:15.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:15.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:16.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:16.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:16.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:17.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:17.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:17.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:17.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:18.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:18.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:18.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:18.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:19.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:19.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:19.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:19.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:20.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:20.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:20.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:20.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:21.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:21.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:21.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:21.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:22.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:22.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:22.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:22.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:23.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:23.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:23.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:23.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:24.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:24.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:24.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:24.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:25.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:25.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:25.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:25.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:26.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:26.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:26.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:26.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:27.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:27.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:27.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:27.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:28.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:28.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:28.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:28.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:28.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:28.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:29.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:29.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:29.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:29.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:30.914 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:30.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:30.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:31.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:31.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:31.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:32.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:32.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:32.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:32.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:32.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:33.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:33.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:33.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:33.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:34.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:34.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:34.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:35.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:35.031+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:35.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:35.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:36.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:36.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:36.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:36.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:37.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:37.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:37.908 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:37.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:37.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:37.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:38.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:38.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:38.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:38.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:39.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:39.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:39.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:39.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:40.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:40.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:40.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:40.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:41.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:41.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:41.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:41.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:42.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:42.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:42.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:42.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:43.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:43.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:43.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:43.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:44.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:44.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:44.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:44.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:45.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:45.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:46.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:46.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:46.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:46.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:46.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:46.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:47.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:47.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:48.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:48.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:48.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:48.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:49.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:49.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:49.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:49.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:50.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:50.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:50.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:50.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:50.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:51.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:51.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:51.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:51.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:51.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:52.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:52.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:52.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:52.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:53.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:53.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:53.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:53.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:54.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:54.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:54.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:54.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:55.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:55.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:55.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:55.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:56.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:56.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:56.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:56.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:57.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:57.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:57.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:57.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:58.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:58.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:58.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:48:59.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:48:59.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:48:59.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:00.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:00.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:00.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:00.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:01.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:01.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:01.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:01.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:02.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:02.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:02.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:02.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:03.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:03.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:03.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:03.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:04.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:04.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:04.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:04.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:05.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:05.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:05.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:05.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:06.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:06.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:06.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:06.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:07.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:07.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:07.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:07.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:08.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:08.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:08.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:08.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:09.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:09.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:09.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:09.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:10.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:10.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:10.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:10.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:11.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:11.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:11.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:11.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:12.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:12.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:12.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:12.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:13.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:13.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:14.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:14.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:14.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:14.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:14.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:14.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:15.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:15.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:15.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:16.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:16.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:16.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:17.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:17.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:17.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:17.177+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:18.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:18.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:18.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:18.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:19.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:19.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:19.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:19.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:20.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:20.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:20.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:20.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:21.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:21.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:21.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:21.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:22.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:22.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:22.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:22.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:23.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:23.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:23.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:23.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:24.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:24.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:24.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:24.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:25.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:25.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:25.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:25.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:26.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:26.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:26.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:26.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:27.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:27.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:27.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:27.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:28.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:28.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:28.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:28.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:29.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:29.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:29.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:29.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:30.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:30.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:30.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:30.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:31.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:31.068+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:31.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:31.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:32.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:32.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:32.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:32.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:33.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:33.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:33.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:33.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:33.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:33.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:34.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:34.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:34.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:34.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:35.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:35.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:35.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:35.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:36.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:36.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:36.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:36.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:37.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:37.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:37.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:37.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:38.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:38.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:38.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:38.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:39.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:39.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:39.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:39.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:40.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:40.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:40.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:40.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:41.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:41.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:41.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:41.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:42.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:42.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:42.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:42.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:43.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:43.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:43.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:43.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:44.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:44.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:44.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:44.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:45.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:45.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:45.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:45.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:46.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:46.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:46.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:46.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:47.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:47.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:47.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:47.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:48.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:48.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:48.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:49.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:49.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:49.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:50.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:50.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:50.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:50.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:51.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:51.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:51.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:51.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:52.070 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:52.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:52.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:52.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:53.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:53.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:53.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:53.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:54.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:54.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:54.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:54.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:55.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:55.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:55.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:55.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:56.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:56.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:56.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:56.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:57.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:57.093+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:57.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:57.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:58.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:58.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:58.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:58.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:59.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:49:59.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:49:59.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:49:59.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:00.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:00.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:00.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:00.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:01.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:01.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:01.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:01.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:02.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:02.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:02.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:02.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:03.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:03.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:03.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:03.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:04.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:04.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:04.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:04.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:05.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:05.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:05.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:05.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:06.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:06.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:06.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:06.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:07.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:07.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:07.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:07.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:08.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:08.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:08.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:08.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:09.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:09.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:09.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:09.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:10.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:10.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:10.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:10.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:11.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:11.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:11.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:11.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:12.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:12.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:12.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:12.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:13.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:13.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:13.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:13.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:14.101 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:14.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:14.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:14.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:15.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:15.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:15.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:15.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:16.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:16.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:16.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:16.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:17.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:17.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:17.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:17.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:18.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:18.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:18.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:18.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:19.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:19.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:19.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:19.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:20.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:20.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:20.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:20.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:21.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:21.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:21.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:21.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:22.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:22.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:22.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:22.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:23.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:23.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:23.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:23.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:24.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:24.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:24.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:24.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:25.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:25.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:25.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:25.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:26.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:26.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:26.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:26.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:27.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:27.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:27.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:27.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:28.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:28.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:28.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:28.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:29.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:29.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:29.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:29.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:30.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:30.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:30.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:30.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:31.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:31.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:31.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:31.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:31.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:32.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:32.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:32.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:32.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:32.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:33.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:33.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:34.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:34.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:34.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:34.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:34.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:35.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:35.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:35.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:35.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:35.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:36.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:36.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:36.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:36.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:37.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:37.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:37.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:37.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:38.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:38.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:38.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:38.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:39.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:39.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:39.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:39.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:40.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:40.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:40.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:40.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:41.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:41.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:41.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:41.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:42.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:42.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:42.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:42.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:43.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:43.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:43.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:43.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:44.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:44.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:44.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:44.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:45.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:45.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:45.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:45.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:46.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:46.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:47.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:47.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:47.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:47.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:47.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:47.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:48.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:48.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:48.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:49.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:49.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:49.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:49.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:49.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:50.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:50.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:50.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:51.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:51.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:51.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:52.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:52.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:52.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:52.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:52.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:53.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:53.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:53.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:53.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:53.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:54.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:54.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:54.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:54.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:55.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:55.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:56.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:56.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:56.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:56.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:57.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:57.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:57.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:57.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:57.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:57.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:58.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:58.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:58.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:58.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:59.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:50:59.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:50:59.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:50:59.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:00.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:00.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:00.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:00.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:01.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:01.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:01.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:01.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:02.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:02.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:02.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:02.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:03.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:03.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:03.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:03.957+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:04.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:04.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:04.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:04.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:05.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:05.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:05.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:05.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:06.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:06.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:06.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:06.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:07.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:07.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:07.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:07.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:08.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:08.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:08.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:08.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:09.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:09.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:09.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:09.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:10.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:10.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:10.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:10.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:11.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:11.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:11.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:11.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:12.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:12.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:12.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:12.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:13.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:13.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:13.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:14.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:14.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:14.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:15.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:15.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:15.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:15.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:16.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:16.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:16.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:16.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:17.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:17.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:17.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:17.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:18.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:18.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:18.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:18.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:19.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:19.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:19.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:19.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:20.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:20.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:20.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:20.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:21.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:21.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:21.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:21.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:22.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:22.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:22.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:22.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:23.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:23.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:23.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:23.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:24.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:24.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:24.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:24.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:25.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:25.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:25.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:25.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:26.089 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:26.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:26.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:26.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:27.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:27.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:27.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:27.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:28.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:28.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:28.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:28.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:29.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:29.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:29.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:29.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:30.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:30.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:30.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:30.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:31.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:31.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:31.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:31.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:32.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:32.151+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:32.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:32.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:33.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:33.113+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:33.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:33.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:34.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:34.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:34.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:34.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:35.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:35.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:35.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:35.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:36.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:36.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:36.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:36.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:37.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:37.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:37.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:37.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:38.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:38.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:38.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:38.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:39.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:39.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:39.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:39.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:40.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:40.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:40.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:40.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:41.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:41.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:41.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:41.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:42.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:42.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:42.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:42.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:43.092 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:43.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:43.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:43.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:44.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:44.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:44.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:44.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:45.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:45.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:45.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:45.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:46.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:46.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:46.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:46.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:47.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:47.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:47.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:47.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:48.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:48.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:48.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:48.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:49.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:49.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:49.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:49.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:50.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:50.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:50.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:50.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:51.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:51.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:51.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:51.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:52.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:52.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:52.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:52.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:52.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:53.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:53.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:53.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:54.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:54.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:54.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:54.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:55.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:55.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:55.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:55.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:56.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:56.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:56.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:56.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:57.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:57.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:57.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:57.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:58.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:58.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:58.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:58.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:58.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:51:58.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:59.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:51:59.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:51:59.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:00.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:00.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:00.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:01.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:01.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:01.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:01.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:01.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:01.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:02.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:02.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:03.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:03.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:03.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:03.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:04.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:04.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:04.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:04.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:05.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:05.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:05.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:05.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:05.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:06.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:06.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:06.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:07.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:07.029+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:07.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:07.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:08.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:08.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:08.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:08.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:09.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:09.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:09.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:09.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:10.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:10.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:10.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:10.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:11.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:11.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:11.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:11.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:12.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:12.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:12.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:12.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:13.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:13.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:13.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:13.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:14.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:14.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:14.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:14.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:15.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:15.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:15.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:15.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:16.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:16.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:16.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:16.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:17.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:17.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:17.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:17.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:18.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:18.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:18.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:18.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:19.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:19.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:19.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:19.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:20.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:20.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:20.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:20.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:21.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:21.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:21.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:21.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:22.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:22.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:22.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:22.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:23.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:23.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:23.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:23.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:24.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:24.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:24.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:24.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:25.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:25.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:25.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:25.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:26.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:26.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:26.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:26.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:27.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:27.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:27.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:27.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:28.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:28.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:28.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:28.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:29.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:29.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:29.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:29.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:30.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:30.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:30.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:30.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:31.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:31.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:31.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:31.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:32.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:32.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:32.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:32.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:33.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:33.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:33.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:33.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:34.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:34.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:34.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:34.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:35.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:35.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:35.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:35.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:36.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:36.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:36.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:36.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:37.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:37.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:37.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:37.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:38.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:38.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:38.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:38.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:39.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:39.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:39.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:39.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:40.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:40.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:40.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:40.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:41.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:41.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:41.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:41.466+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:42.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:42.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:42.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:42.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:43.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:43.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:43.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:43.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:44.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:44.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:44.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:44.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:45.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:45.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:45.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:45.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:46.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:46.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:46.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:46.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:47.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:47.310+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:47.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:47.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:48.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:48.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:48.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:48.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:49.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:49.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:49.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:49.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:50.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:50.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:50.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:50.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:51.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:51.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:51.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:51.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:52.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:52.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:52.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:52.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:53.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:53.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:53.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:53.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:54.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:54.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:54.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:54.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:55.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:55.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:55.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:55.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:56.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:56.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:56.579 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:56.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:57.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:57.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:57.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:57.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:58.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:58.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:58.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:58.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:59.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:52:59.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:52:59.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:52:59.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:00.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:00.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:00.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:00.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:01.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:01.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:01.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:01.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:02.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:02.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:02.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:02.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:03.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:03.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:03.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:03.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:04.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:04.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:04.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:04.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:05.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:05.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:05.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:05.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:06.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:06.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:06.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:06.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:07.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:07.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:07.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:07.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:08.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:08.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:08.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:08.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:09.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:09.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:09.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:09.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:10.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:10.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:10.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:10.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:11.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:11.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:11.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:11.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:12.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:12.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:12.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:12.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:13.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:13.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:13.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:13.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:14.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:14.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:14.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:14.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:15.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:15.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:15.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:15.462+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:16.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:16.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:16.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:16.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:17.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:17.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:17.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:17.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:18.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:18.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:18.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:18.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:19.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:19.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:19.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:19.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:20.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:20.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:20.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:20.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:21.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:21.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:21.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:21.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:22.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:22.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:22.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:22.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:23.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:23.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:23.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:23.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:24.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:24.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:24.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:24.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:25.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:25.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:25.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:25.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:26.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:26.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:26.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:26.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:27.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:27.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:27.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:27.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:28.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:28.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:28.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:28.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:29.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:29.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:29.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:29.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:30.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:30.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:30.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:30.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:31.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:31.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:31.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:31.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:32.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:32.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:32.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:32.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:33.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:33.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:33.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:33.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:34.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:34.407+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:34.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:34.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:35.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:35.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:35.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:35.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:36.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:36.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:36.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:36.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:37.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:37.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:37.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:37.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:38.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:38.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:38.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:38.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:39.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:39.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:39.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:39.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:40.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:40.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:40.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:40.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:41.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:41.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:41.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:41.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:42.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:42.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:42.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:42.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:43.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:43.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:43.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:43.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:44.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:44.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:44.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:44.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:45.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:45.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:45.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:45.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:46.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:46.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:46.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:46.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:47.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:47.474+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:47.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:47.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:48.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:48.458+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:48.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:48.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:49.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:49.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:49.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:49.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:50.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:50.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:50.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:50.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:51.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:51.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:51.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:51.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:52.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:52.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:52.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:52.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:53.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:53.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:53.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:53.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:54.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:54.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:54.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:54.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:55.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:55.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:55.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:55.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:56.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:56.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:56.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:56.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:57.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:57.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:57.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:57.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:58.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:58.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:58.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:58.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:59.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:53:59.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:53:59.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:53:59.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:00.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:00.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:00.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:00.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:01.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:01.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:01.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:01.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:02.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:02.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:02.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:02.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:03.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:03.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:03.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:03.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:04.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:04.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:04.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:04.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:05.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:05.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:05.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:05.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:06.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:06.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:06.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:06.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:07.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:07.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:07.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:07.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:08.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:08.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:08.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:08.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:09.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:09.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:09.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:09.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:10.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:10.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:10.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:10.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:11.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:11.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:11.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:11.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:12.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:12.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:12.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:12.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:13.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:13.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:13.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:13.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:14.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:14.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:14.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:14.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:15.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:15.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:15.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:15.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:16.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:16.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:16.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:16.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:17.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:17.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:17.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:17.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:18.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:18.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:18.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:18.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:19.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:19.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:19.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:19.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:20.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:20.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:20.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:20.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:21.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:21.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:21.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:21.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:22.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:22.342+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:22.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:22.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:23.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:23.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:23.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:23.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:24.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:24.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:24.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:24.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:25.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:25.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:25.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:25.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:26.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:26.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:26.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:26.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:27.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:27.321+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:27.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:27.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:28.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:28.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:28.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:28.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:29.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:29.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:29.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:29.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:30.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:30.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:30.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:30.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:31.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:31.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:31.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:31.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:32.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:32.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:32.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:32.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:33.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:33.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:33.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:33.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:34.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:34.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:34.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:34.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:35.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:35.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:35.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:35.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:36.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:36.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:36.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:36.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:37.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:37.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:37.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:37.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:38.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:38.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:38.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:38.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:39.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:39.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:39.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:39.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:40.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:40.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:40.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:40.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:41.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:41.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:41.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:41.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:42.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:42.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:42.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:42.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:43.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:43.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:43.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:43.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:44.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:44.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:44.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:44.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:45.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:45.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:45.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:45.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:46.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:46.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:46.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:46.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:47.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:47.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:47.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:47.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:48.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:48.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:48.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:48.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:49.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:49.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:49.735 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:49.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:50.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:50.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:50.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:50.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:51.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:51.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:51.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:51.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:52.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:52.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:52.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:52.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:53.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:53.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:53.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:53.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:54.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:54.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:54.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:54.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:55.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:55.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:55.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:55.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:56.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:56.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:56.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:56.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:57.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:57.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:57.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:57.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:58.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:58.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:58.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:58.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:59.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:54:59.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:54:59.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:54:59.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:00.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:00.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:00.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:00.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:01.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:01.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:01.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:01.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:02.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:02.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:02.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:02.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:03.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:03.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:03.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:03.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:04.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:04.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:04.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:04.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:05.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:05.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:05.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:05.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:06.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:06.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:06.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:06.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:07.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:07.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:07.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:07.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:08.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:08.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:08.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:08.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:09.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:09.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:09.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:09.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:10.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:10.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:10.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:10.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:11.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:11.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:11.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:11.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:12.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:12.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:12.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:12.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:13.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:13.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:13.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:13.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:14.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:14.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:14.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:14.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:15.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:15.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:15.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:15.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:16.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:16.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:16.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:16.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:17.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:17.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:17.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:17.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:18.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:18.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:18.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:18.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:19.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:19.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:19.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:19.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:20.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:20.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:20.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:20.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:21.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:21.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:21.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:21.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:22.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:22.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:22.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:22.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:23.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:23.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:23.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:23.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:24.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:24.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:24.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:24.842+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:25.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:25.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:25.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:25.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:26.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:26.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:26.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:26.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:27.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:27.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:27.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:27.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:28.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:28.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:28.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:28.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:29.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:29.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:29.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:29.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:30.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:30.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:30.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:30.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:31.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:31.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:31.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:31.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:32.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:32.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:32.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:32.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:33.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:33.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:33.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:33.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:34.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:34.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:34.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:34.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:35.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:35.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:35.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:35.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:36.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:36.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:36.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:36.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:37.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:37.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:37.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:37.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:38.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:38.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:38.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:38.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:39.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:39.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:39.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:39.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:40.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:40.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:40.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:40.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:41.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:41.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:41.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:41.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:42.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:42.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:42.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:42.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:43.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:43.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:43.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:43.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:44.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:44.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:44.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:44.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:45.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:45.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:45.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:45.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:46.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:46.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:46.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:46.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:47.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:47.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:47.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:47.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:48.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:48.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:48.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:48.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:49.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:49.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:49.802 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:49.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:50.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:50.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:50.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:50.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:51.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:51.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:51.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:51.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:52.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:52.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:52.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:52.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:53.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:53.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:53.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:53.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:54.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:54.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:54.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:54.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:55.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:55.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:55.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:55.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:56.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:56.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:56.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:56.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:57.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:57.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:57.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:57.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:58.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:58.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:58.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:58.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:59.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:55:59.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:55:59.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:55:59.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:00.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:00.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:00.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:00.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:01.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:01.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:01.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:01.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:02.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:02.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:02.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:02.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:03.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:03.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:03.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:03.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:04.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:04.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:04.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:04.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:05.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:05.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:05.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:05.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:06.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:06.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:06.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:06.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:07.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:07.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:07.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:07.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:08.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:08.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:08.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:08.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:09.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:09.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:09.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:09.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:10.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:10.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:10.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:10.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:11.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:11.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:11.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:11.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:12.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:12.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:12.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:12.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:13.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:13.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:13.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:13.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:14.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:14.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:14.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:14.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:15.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:15.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:15.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:15.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:16.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:16.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:16.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:16.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:17.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:17.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:17.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:17.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:18.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:18.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:18.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:18.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:19.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:19.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:19.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:19.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:20.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:20.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:20.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:20.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:21.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:21.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:21.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:21.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:22.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:22.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:22.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:22.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:23.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:23.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:23.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:23.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:24.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:24.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:24.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:24.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:25.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:25.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:25.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:25.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:26.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:26.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:26.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:26.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:27.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:27.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:27.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:27.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:28.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:28.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:28.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:28.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:29.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:29.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:29.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:29.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:30.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:30.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:30.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:30.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:31.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:31.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:31.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:31.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:32.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:32.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:32.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:32.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:33.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:33.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:33.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:33.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:34.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:34.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:34.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:34.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:35.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:35.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:35.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:35.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:36.515 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:36.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:36.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:36.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:37.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:37.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:37.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:37.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:38.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:38.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:38.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:38.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:39.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:39.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:39.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:39.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:40.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:40.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:40.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:40.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:41.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:41.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:41.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:41.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:42.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:42.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:42.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:42.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:43.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:43.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:43.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:43.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:44.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:44.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:44.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:44.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:45.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:45.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:45.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:45.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:46.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:46.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:46.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:46.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:47.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:47.483+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:47.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:48.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:48.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:48.450+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:48.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:48.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:49.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:49.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:49.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:49.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:50.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:50.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:51.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:51.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:51.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:51.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:52.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:52.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:52.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:52.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:53.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:53.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:53.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:53.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:54.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:54.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:54.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:54.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:55.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:55.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:55.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:55.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:56.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:56.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:56.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:56.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:57.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:57.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:57.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:57.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:58.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:58.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:58.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:58.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:59.080 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:56:59.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:56:59.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:56:59.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:00.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:00.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:00.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:00.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:01.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:01.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:01.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:01.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:02.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:02.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:02.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:02.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:03.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:03.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:03.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:03.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:04.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:04.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:04.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:04.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:05.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:05.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:05.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:05.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:06.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:06.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:06.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:06.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:07.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:07.181+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:07.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:07.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:08.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:08.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:08.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:08.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:09.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:09.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:09.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:09.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:10.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:10.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:10.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:10.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:11.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:11.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:11.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:11.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:12.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:12.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:12.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:12.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:13.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:13.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:13.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:13.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:14.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:14.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:14.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:14.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:15.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:15.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:15.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:15.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:16.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:16.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:16.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:16.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:17.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:17.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:17.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:17.447+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:18.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:18.237+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:18.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:18.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:19.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:19.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:19.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:19.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:20.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:20.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:20.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:20.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:21.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:21.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:21.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:21.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:22.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:22.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:22.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:22.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:23.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:23.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:23.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:23.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:24.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:24.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:24.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:24.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:25.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:25.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:25.451 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:25.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:26.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:26.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:26.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:26.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:27.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:27.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:27.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:27.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:28.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:28.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:28.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:28.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:29.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:29.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:29.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:29.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:30.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:30.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:30.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:30.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:31.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:31.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:31.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:31.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:32.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:32.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:32.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:32.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:33.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:33.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:33.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:33.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:34.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:34.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:34.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:34.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:35.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:35.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:35.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:35.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:36.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:36.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:36.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:36.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:37.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:37.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:37.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:37.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:38.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:38.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:38.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:38.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:39.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:39.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:39.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:39.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:40.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:40.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:40.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:40.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:41.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:41.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:41.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:41.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:42.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:42.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:42.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:42.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:43.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:43.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:43.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:43.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:44.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:44.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:44.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:44.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:45.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:45.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:45.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:45.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:46.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:46.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:46.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:46.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:47.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:47.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:47.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:47.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:48.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:48.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:48.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:48.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:49.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:49.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:49.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:49.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:50.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:50.574+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:50.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:50.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:51.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:51.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:51.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:51.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:52.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:52.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:52.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:52.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:53.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:53.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:53.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:53.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:54.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:54.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:54.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:54.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:55.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:55.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:55.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:55.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:56.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:56.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:56.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:56.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:57.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:57.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:57.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:57.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:58.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:58.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:58.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:58.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:59.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:57:59.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:57:59.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:57:59.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:00.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:00.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:00.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:00.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:01.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:01.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:01.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:01.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:02.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:02.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:02.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:02.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:03.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:03.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:03.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:03.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:04.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:04.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:04.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:04.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:05.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:05.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:05.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:05.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:06.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:06.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:06.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:06.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:07.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:07.501+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:07.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:07.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:08.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:08.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:08.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:08.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:09.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:09.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:09.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:09.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:10.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:10.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:10.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:10.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:11.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:11.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:11.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:11.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:12.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:12.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:12.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:12.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:13.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:13.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:13.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:13.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:14.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:14.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:14.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:14.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:15.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:15.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:15.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:15.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:16.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:16.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:16.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:16.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:17.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:17.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:17.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:17.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:18.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:18.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:18.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:18.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:19.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:19.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:19.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:19.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:20.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:20.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:20.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:20.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:21.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:21.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:21.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:21.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:22.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:22.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:22.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:22.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:23.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:23.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:23.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:23.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:24.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:24.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:24.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:24.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:25.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:25.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:25.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:25.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:26.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:26.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:26.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:26.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:27.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:27.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:27.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:27.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:28.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:28.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:28.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:28.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:29.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:29.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:29.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:29.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:30.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:30.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:30.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:30.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:31.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:31.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:31.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:31.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:32.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:32.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:32.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:32.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:33.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:33.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:33.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:33.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:34.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:34.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:34.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:34.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:35.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:35.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:35.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:35.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:36.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:36.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:36.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:36.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:37.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:37.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:37.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:37.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:38.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:38.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:38.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:38.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:39.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:39.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:39.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:39.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:40.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:40.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:40.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:40.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:41.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:41.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:41.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:41.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:42.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:42.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:42.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:42.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:43.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:43.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:43.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:43.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:44.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:44.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:44.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:44.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:45.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:45.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:45.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:45.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:46.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:46.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:46.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:46.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:47.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:47.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:47.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:47.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:48.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:48.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:48.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:48.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:49.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:49.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:49.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:49.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:50.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:50.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:50.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:50.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:51.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:51.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:51.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:51.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:52.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:52.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:52.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:52.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:53.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:53.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:53.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:53.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:54.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:54.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:54.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:54.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:55.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:55.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:55.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:55.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:56.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:56.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:56.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:56.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:57.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:57.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:57.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:57.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:58.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:58.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:58.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:58.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:59.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:58:59.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:58:59.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:58:59.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:00.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:00.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:00.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:00.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:01.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:01.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:01.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:01.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:02.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:02.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:02.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:02.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:03.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:03.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:03.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:03.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:04.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:04.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:04.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:04.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:05.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:05.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:05.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:05.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:06.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:06.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:06.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:06.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:07.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:07.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:07.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:07.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:08.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:08.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:08.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:08.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:09.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:09.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:09.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:09.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:10.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:10.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:10.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:10.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:11.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:11.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:11.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:11.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:12.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:12.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:12.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:12.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:13.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:13.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:13.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:13.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:14.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:14.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:14.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:14.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:15.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:15.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:15.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:15.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:16.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:16.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:16.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:16.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:17.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:17.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:17.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:17.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:18.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:18.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:18.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:18.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:19.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:19.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:19.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:19.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:20.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:20.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:20.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:20.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:21.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:21.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:21.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:21.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:22.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:22.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:22.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:22.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:23.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:23.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:23.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:23.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:24.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:24.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:24.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:24.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:25.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:25.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:25.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:25.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:26.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:26.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:26.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:26.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:27.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:27.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:27.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:27.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:28.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:28.510+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:28.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:28.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:29.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:29.543+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:29.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:29.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:30.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:30.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:30.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:30.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:31.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:31.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:31.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:31.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:32.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:32.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:32.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:32.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:33.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:33.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:33.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:33.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:34.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:34.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:34.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:34.889+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:35.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:35.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:35.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:35.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:36.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:36.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:36.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:36.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:37.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:37.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:37.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:37.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:38.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:38.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:38.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:38.896+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:39.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:39.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:39.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:39.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:40.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:40.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:40.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:40.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:41.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:41.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:41.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:41.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:42.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:42.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:42.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:42.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:43.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:43.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:43.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:43.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:44.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:44.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:44.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:44.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:45.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:45.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:45.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:45.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:46.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:46.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:46.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:46.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:47.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:47.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:48.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:48.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:48.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:48.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:48.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:48.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:49.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:49.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:49.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:49.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:50.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:50.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:51.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:51.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:51.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:51.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:52.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:52.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:52.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:52.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:53.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:53.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:53.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:53.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:54.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:54.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:54.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:54.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:55.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:55.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:55.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:55.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:56.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:56.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:56.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:56.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:57.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:57.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:57.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:57.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:57.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:58.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:58.503 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:58.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:58.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T01:59:58.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T01:59:59.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T01:59:59.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:00.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:00.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:00.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:00.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:01.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:01.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:01.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:01.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:02.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:02.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:02.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:02.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:03.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:03.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:03.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:03.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:04.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:04.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:04.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:04.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:04.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:04.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:05.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:05.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:05.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:05.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:06.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:06.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:06.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:07.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:07.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:07.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:07.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:07.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:08.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:08.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:08.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:08.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:09.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:09.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:09.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:09.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:10.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:10.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:10.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:11.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:11.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:11.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:11.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:11.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:12.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:12.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:13.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:13.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:13.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:13.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:13.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:13.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:14.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:14.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:15.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:15.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:15.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:15.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:16.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:16.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:16.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:16.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:17.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:17.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:17.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:17.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:17.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:18.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:18.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:18.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:18.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:18.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:19.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:19.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:19.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:19.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:20.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:20.800+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:20.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:20.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:21.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:21.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:21.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:21.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:22.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:22.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:22.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:22.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:23.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:23.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:23.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:23.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:24.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:24.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:24.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:24.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:25.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:25.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:25.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:25.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:26.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:26.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:26.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:26.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:27.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:27.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:27.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:27.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:28.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:28.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:28.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:28.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:29.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:29.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:29.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:29.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:30.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:30.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:30.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:30.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:31.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:31.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:31.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:31.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:32.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:32.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:32.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:32.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:33.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:33.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:33.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:33.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:34.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:34.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:34.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:34.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:35.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:35.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:35.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:35.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:36.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:36.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:36.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:36.919+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:37.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:37.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:37.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:37.909+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:38.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:38.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:38.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:38.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:39.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:39.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:39.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:39.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:40.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:40.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:40.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:40.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:41.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:41.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:41.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:41.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:42.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:42.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:42.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:42.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:43.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:43.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:43.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:43.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:44.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:44.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:44.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:44.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:45.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:45.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:45.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:45.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:46.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:46.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:46.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:46.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:47.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:47.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:47.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:47.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:48.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:48.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:48.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:48.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:49.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:49.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:49.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:49.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:50.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:50.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:50.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:50.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:51.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:51.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:51.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:51.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:52.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:52.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:52.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:52.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:53.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:53.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:53.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:53.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:54.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:54.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:54.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:54.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:55.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:55.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:55.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:55.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:56.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:56.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:56.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:56.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:57.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:57.769+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:57.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:57.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:58.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:58.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:58.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:58.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:59.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:00:59.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:00:59.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:00:59.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:00.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:00.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:00.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:00.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:01.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:01.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:01.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:01.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:02.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:02.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:02.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:02.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:03.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:03.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:03.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:03.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:04.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:04.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:04.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:04.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:05.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:05.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:05.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:05.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:06.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:06.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:06.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:06.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:07.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:07.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:07.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:07.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:08.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:08.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:08.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:08.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:09.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:09.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:09.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:09.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:10.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:10.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:10.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:10.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:11.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:11.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:11.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:11.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 135 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:12.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:12.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:12.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:12.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:13.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:13.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:13.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:13.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:14.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:14.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:14.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:14.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:15.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:15.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:15.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:15.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:16.747 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:16.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:16.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:16.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:17.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:17.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:17.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:17.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:18.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:18.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:18.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:18.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:19.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:19.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:19.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:19.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:20.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:20.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:20.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:20.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:21.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:21.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:21.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:21.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:22.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:22.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:22.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:22.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:23.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:23.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:23.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:23.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:24.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:24.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:24.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:24.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:25.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:25.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:25.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:25.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:26.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:26.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:26.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:26.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:27.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:27.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:27.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:27.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:28.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:28.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:28.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:28.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:29.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:29.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:29.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:29.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:30.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:30.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:30.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:30.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:31.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:31.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:31.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:31.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:32.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:32.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:32.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:32.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:33.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:33.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:33.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:33.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:34.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:34.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:34.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:34.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:35.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:35.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:35.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:35.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:36.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:36.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:36.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:36.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:37.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:37.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:37.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:37.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:38.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:38.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:38.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:38.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:39.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:39.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:39.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:39.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:40.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:40.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:40.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:40.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:41.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:41.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:41.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:41.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 25 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:01:42.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:42.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:42.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:42.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:43.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:43.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:43.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:43.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:44.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:44.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:44.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:44.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:45.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:45.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:45.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:45.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:46.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:46.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:46.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:46.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:47.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:47.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:47.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:47.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:48.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:48.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:48.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:48.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:49.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:49.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:49.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:49.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:50.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:50.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:50.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:50.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:51.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:51.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:51.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:51.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:52.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:52.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:52.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:52.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:53.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:53.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:53.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:53.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:54.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:54.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:54.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:54.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:55.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:55.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:55.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:55.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:56.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:56.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:56.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:56.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:57.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:57.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:57.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:57.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:58.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:58.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:58.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:58.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:59.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:01:59.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:01:59.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:01:59.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:00.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:00.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:00.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:00.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:01.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:01.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:01.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:01.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:02.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:02.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:02.643 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:02.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:03.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:03.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:03.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:03.666+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:04.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:04.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:04.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:04.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:05.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:05.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:05.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:05.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:06.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:06.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:06.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:06.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:07.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:07.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:07.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:07.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:08.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:08.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:08.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:08.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:09.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:09.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:09.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:09.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:10.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:10.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:10.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:10.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:11.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:11.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:11.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:11.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:12.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:12.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:12.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:12.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:13.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:13.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:13.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:13.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:14.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:14.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:14.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:14.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:15.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:15.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:15.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:15.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:16.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:16.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:16.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:16.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:17.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:17.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:17.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:17.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:18.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:18.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:18.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:18.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:19.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:19.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:19.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:19.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:20.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:20.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:20.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:20.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:21.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:21.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:21.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:21.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:22.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:22.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:22.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:22.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:23.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:23.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:23.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:23.766+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:24.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:24.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:24.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:24.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:25.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:25.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:25.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:25.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:26.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:26.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:26.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:26.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:27.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:27.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:27.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:27.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:28.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:28.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:28.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:28.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:29.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:29.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:29.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:29.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:30.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:30.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:30.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:30.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:31.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:31.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:31.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:31.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:32.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:32.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:32.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:32.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:33.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:33.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:33.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:33.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:34.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:34.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:34.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:34.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:35.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:35.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:35.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:35.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:36.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:36.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:36.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:36.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:37.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:37.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:37.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:37.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:38.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:38.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:38.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:38.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:39.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:39.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:39.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:39.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:40.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:40.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:40.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:40.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:41.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:41.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:41.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:41.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:42.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:42.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:42.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:42.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:43.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:43.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:43.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:43.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:44.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:44.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:44.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:44.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:45.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:45.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:45.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:45.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:46.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:46.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:46.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:46.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:47.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:47.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:47.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:47.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:48.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:48.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:48.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:48.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:49.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:49.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:49.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:49.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:50.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:50.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:50.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:50.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:51.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:51.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:51.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:51.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:52.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:52.880+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:52.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:52.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:53.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:53.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:53.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:53.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:54.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:54.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:54.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:54.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:55.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:55.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:55.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:55.892+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:56.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:56.868+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:56.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:56.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:57.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:57.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:57.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:57.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:58.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:58.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:58.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:58.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:59.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:02:59.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:02:59.921 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:02:59.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:00.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:00.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:00.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:00.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:01.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:01.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:01.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:01.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:02.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:02.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:02.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:02.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:03.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:03.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:03.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:03.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:04.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:04.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:04.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:04.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:05.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:05.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:05.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:05.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:06.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:06.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:06.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:06.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:07.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:07.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:07.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:07.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:08.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:08.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:08.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:08.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:09.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:09.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:09.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:09.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:10.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:10.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:10.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:10.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:11.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:11.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:11.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:11.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:12.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:12.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:12.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:12.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:13.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:13.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:13.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:13.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:14.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:14.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:14.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:14.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:15.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:15.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:15.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:15.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:16.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:16.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:16.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:16.862+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:17.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:17.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:17.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:17.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:18.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:18.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:18.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:18.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:19.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:19.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:19.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:19.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:20.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:20.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:20.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:20.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:21.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:21.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:21.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:21.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:22.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:22.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:22.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:22.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:23.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:23.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:23.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:23.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:24.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:24.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:24.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:24.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:25.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:25.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:25.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:25.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:26.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:26.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:26.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:26.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:27.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:27.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:27.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:27.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:28.822 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:28.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:28.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:28.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:29.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:29.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:29.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:29.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:30.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:30.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:30.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:30.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:31.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:31.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:31.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:31.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:32.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:32.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:32.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:32.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:33.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:33.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:33.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:33.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:34.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:34.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:34.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:34.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:35.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:35.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:35.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:35.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:36.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:36.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:36.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:36.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:37.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:37.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:37.894 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:37.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:38.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:38.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:38.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:38.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:39.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:39.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:39.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:39.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:40.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:40.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:40.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:40.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:41.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:41.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:41.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:41.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:42.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:42.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:42.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:42.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:43.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:43.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:43.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:43.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:44.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:44.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:44.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:44.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:45.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:45.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:45.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:45.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:46.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:46.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:46.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:46.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:47.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:47.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:47.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:47.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:48.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:48.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:48.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:48.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:49.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:49.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:49.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:49.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:50.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:50.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:50.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:50.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:51.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:51.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:51.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:51.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:52.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:52.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:52.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:52.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:53.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:53.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:53.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:53.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:54.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:54.827+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:54.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:54.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:55.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:55.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:55.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:55.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:56.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:56.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:56.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:56.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:57.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:57.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:57.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:57.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:58.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:58.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:58.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:58.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:59.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:03:59.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:03:59.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:03:59.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:00.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:00.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:00.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:00.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:01.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:01.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:01.954 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:01.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:02.920 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:02.933+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:02.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:02.973+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:03.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:03.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:03.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:03.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:04.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:04.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:04.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:04.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:05.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:05.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:05.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:05.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:06.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:06.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:06.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:06.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:07.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:07.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:08.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:08.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:08.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:08.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:09.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:09.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:09.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:09.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:10.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:10.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:10.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:10.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:11.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:11.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:11.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:11.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:12.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:12.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:12.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:12.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:12.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:13.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:13.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:13.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:14.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:14.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:14.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:14.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:15.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:15.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:15.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:15.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:16.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:16.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:16.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:16.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:17.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:17.048+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:17.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:17.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:18.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:18.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:18.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:18.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:19.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:19.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:19.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:19.858+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:19.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:20.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:20.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:20.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:20.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:20.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:21.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:21.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:21.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:22.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:22.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:22.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:23.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:23.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:23.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:23.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:24.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:24.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:24.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:24.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:25.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:25.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:25.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:25.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:26.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:26.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:26.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:26.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:27.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:27.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:27.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:27.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:28.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:28.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:28.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:28.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:29.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:29.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:29.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:29.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:30.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:30.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:30.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:30.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:31.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:31.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:31.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:31.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:32.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:32.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:32.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:32.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:33.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:33.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:33.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:33.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:34.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:34.126+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:34.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:34.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:35.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:35.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:35.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:35.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:36.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:36.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:36.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:36.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:37.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:37.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:37.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:37.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:38.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:38.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:38.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:38.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:39.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:39.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:39.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:40.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:40.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:40.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:41.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:41.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:41.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:41.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:41.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:42.001+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:42.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:42.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:42.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:42.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:42.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:43.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:43.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:43.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:43.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:43.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:44.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:44.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:44.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:44.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:45.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:45.898+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:45.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:45.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:46.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:46.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:47.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:47.030+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:47.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:47.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:48.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:48.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:48.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:48.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:49.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:49.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:49.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:49.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:50.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:50.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:50.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:50.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:51.130 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:51.143+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:51.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:51.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:52.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:52.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:52.929 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:52.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:53.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:53.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:53.971 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:53.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:54.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:54.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:54.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:54.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:55.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:55.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:55.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:55.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:56.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:56.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:56.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:56.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:57.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:57.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:57.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:57.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:58.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:58.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:58.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:58.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:59.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:04:59.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:04:59.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:04:59.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:00.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:00.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:00.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:00.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:01.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:01.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:01.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:01.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:02.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:02.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:02.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:02.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:03.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:03.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:03.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:03.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:04.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:04.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:04.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:04.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:05.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:05.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:05.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:05.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:06.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:06.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:06.850 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:06.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:07.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:07.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:07.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:07.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:08.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:08.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:08.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:08.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:09.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:09.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:09.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:09.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:10.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:10.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:10.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:10.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:11.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:11.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:11.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:11.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:12.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:12.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:12.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:12.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:13.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:13.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:13.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:13.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:14.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:14.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:14.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:14.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:15.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:15.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:15.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:15.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:16.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:16.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:16.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:16.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:17.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:17.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:17.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:17.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:18.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:18.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:18.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:18.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:19.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:19.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:19.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:19.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:20.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:20.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:20.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:20.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:21.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:21.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:21.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:21.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:22.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:22.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:22.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:22.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:23.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:23.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:23.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:23.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:24.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:24.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:24.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:24.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:25.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:25.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:25.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:25.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:26.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:26.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:26.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:26.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:27.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:27.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:27.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:27.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:28.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:28.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:28.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:28.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:29.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:29.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:29.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:29.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:30.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:30.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:30.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:30.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:31.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:31.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:31.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:31.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:32.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:32.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:32.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:32.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:33.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:33.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:33.886 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:33.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:34.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:34.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:34.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:34.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:35.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:35.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:35.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:35.949+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:36.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:36.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:36.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:36.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:37.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:37.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:37.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:37.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:38.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:38.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:38.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:38.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:39.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:39.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:39.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:39.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:40.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:40.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:40.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:40.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:41.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:41.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:41.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:41.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:42.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:42.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:42.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:42.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:43.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:43.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:43.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:43.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:44.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:44.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:44.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:44.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:45.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:45.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:45.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:45.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:46.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:46.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:46.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:46.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:47.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:47.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:47.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:47.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:48.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:48.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:48.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:48.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:49.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:49.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:49.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:49.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:50.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:50.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:50.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:50.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:51.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:51.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:51.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:51.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:52.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:52.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:52.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:52.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:53.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:53.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:53.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:53.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:54.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:54.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:54.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:54.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:55.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:55.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:55.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:55.799+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:56.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:56.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:56.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:56.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:57.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:57.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:57.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:57.710+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:58.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:58.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:58.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:58.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:59.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:05:59.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:05:59.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:05:59.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:00.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:00.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:00.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:00.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:01.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:01.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:01.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:01.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:02.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:02.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:02.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:02.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:03.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:03.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:03.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:03.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:04.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:04.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:04.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:04.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:05.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:05.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:05.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:05.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:06.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:06.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:06.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:06.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:07.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:07.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:07.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:07.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:08.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:08.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:08.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:08.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:09.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:09.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:09.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:09.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:10.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:10.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:10.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:10.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:11.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:11.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:11.930 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:11.944+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:12.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:12.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:12.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:12.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:13.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:13.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:13.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:14.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:14.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:14.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:14.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:15.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:15.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:15.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:16.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:16.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:16.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:16.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:16.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:16.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:17.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:17.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:17.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:17.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:18.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:18.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:18.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:18.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:19.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:19.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:19.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:20.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:20.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:20.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:21.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:21.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:21.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:21.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:22.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:22.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:22.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:22.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:23.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:23.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:23.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:23.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:24.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:24.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:24.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:24.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:25.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:25.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:25.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:25.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:26.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:26.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:26.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:26.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:27.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:27.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:27.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:27.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:28.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:28.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:28.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:28.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:29.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:29.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:29.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:29.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:30.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:30.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:30.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:30.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:31.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:31.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:31.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:31.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:32.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:32.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:32.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:32.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:33.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:33.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:33.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:33.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:34.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:34.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:34.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:34.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:35.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:35.035+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:35.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:35.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:36.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:36.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:36.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:36.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:37.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:37.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:37.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:37.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:38.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:38.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:38.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:38.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:39.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:39.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:39.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:39.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:40.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:40.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:40.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:40.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:41.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:41.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:41.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:41.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:42.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:42.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:42.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:42.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:43.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:43.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:43.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:43.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:44.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:44.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:44.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:44.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:45.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:45.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:45.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:45.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:46.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:46.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:46.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:46.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:47.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:47.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:47.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:47.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:48.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:48.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:48.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:48.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:49.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:49.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:49.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:49.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:50.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:50.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:50.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:50.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:51.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:51.165+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:51.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:51.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:52.163 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:52.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:52.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:52.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:53.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:53.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:53.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:53.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:54.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:54.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:54.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:54.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:55.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:55.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:55.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:55.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:56.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:56.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:56.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:56.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:57.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:57.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:57.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:57.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:58.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:58.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:58.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:58.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:59.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:06:59.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:06:59.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:06:59.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:00.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:00.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:00.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:00.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:01.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:01.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:01.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:01.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:02.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:02.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:02.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:02.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:03.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:03.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:03.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:03.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:04.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:04.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:04.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:04.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:05.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:05.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:05.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:05.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:06.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:06.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:06.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:06.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:07.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:07.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:07.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:07.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:08.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:08.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:08.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:08.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:09.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:09.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:09.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:09.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:10.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:10.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:10.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:10.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:11.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:11.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:11.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:11.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:12.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:12.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:12.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:12.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:13.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:13.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:13.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:13.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:14.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:14.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:14.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:14.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:15.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:15.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:15.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:15.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:16.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:16.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:16.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:16.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:17.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:17.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:17.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:17.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:18.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:18.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:18.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:18.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:19.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:19.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:19.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:19.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:20.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:20.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:20.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:20.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:21.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:21.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:21.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:21.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:22.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:22.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:22.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:22.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:23.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:23.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:23.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:23.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:24.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:24.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:24.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:24.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:25.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:25.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:25.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:25.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:26.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:26.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:26.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:26.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:27.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:27.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:27.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:27.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:28.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:28.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:28.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:28.427+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:29.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:29.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:29.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:29.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:30.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:30.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:30.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:30.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:31.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:31.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:31.406 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:31.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:32.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:32.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:32.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:32.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:33.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:33.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:33.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:33.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:34.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:34.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:34.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:34.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:35.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:35.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:35.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:35.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:36.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:36.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:36.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:36.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:37.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:37.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:37.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:37.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:38.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:38.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:38.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:38.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:39.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:39.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:39.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:39.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:40.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:40.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:40.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:40.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:41.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:41.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:41.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:41.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:42.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:42.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:42.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:42.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:43.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:43.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:43.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:43.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:44.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:44.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:44.445 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:44.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:45.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:45.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:45.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:45.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:46.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:46.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:46.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:46.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:47.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:47.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:47.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:47.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:48.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:48.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:48.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:48.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:49.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:49.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:49.508 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:49.523+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:50.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:50.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:50.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:50.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:51.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:51.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:51.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:51.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:52.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:52.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:52.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:52.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:53.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:53.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:53.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:53.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:54.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:54.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:54.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:54.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:55.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:55.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:55.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:55.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:56.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:56.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:56.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:56.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:57.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:57.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:57.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:57.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:58.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:58.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:58.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:58.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:59.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:07:59.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:07:59.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:07:59.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:00.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:00.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:00.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:00.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:01.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:01.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:01.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:01.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:02.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:02.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:02.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:02.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:03.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:03.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:03.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:03.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:04.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:04.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:04.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:04.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:05.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:05.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:05.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:05.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:06.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:06.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:06.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:06.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:07.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:07.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:07.572 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:07.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:08.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:08.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:08.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:08.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:09.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:09.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:09.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:09.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:10.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:10.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:10.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:10.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:11.538 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:11.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:11.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:11.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:12.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:12.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:12.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:12.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:13.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:13.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:13.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:13.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:14.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:14.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:14.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:14.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:15.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:15.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:15.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:15.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:16.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:16.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:16.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:16.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:17.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:17.564+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:17.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:17.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:18.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:18.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:18.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:18.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:19.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:19.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:19.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:19.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:20.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:20.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:20.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:20.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:21.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:21.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:21.582 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:21.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:22.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:22.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:22.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:22.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:23.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:23.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:23.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:23.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:24.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:24.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:24.543 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:24.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:25.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:25.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:25.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:25.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:26.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:26.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:26.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:26.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:27.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:27.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:27.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:27.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:28.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:28.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:28.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:28.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:29.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:29.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:29.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:29.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:30.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:30.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:30.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:30.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:31.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:31.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:31.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:31.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:32.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:32.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:32.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:32.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:33.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:33.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:33.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:33.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:34.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:34.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:34.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:34.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:35.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:35.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:35.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:35.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:36.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:36.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:36.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:36.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:37.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:37.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:37.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:37.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:38.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:38.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:38.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:38.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:39.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:39.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:39.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:39.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:40.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:40.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:40.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:40.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:41.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:41.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:41.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:41.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:42.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:42.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:42.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:42.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:43.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:43.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:43.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:43.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:44.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:44.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:44.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:44.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:45.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:45.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:45.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:45.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:46.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:46.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:46.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:46.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:47.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:47.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:47.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:47.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:48.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:48.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:48.674 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:48.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:49.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:49.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:49.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:49.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:50.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:50.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:50.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:50.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:51.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:51.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:51.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:51.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:52.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:52.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:52.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:52.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:53.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:53.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:53.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:53.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:54.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:54.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:54.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:54.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:55.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:55.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:55.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:55.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:56.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:56.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:56.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:56.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:57.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:57.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:57.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:57.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:58.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:58.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:58.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:58.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:59.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:08:59.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:08:59.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:08:59.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:00.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:00.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:00.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:00.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:01.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:01.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:01.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:01.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:02.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:02.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:02.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:02.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:03.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:03.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:03.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:03.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:04.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:04.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:04.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:04.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:05.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:05.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:05.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:05.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:06.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:06.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:06.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:06.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:07.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:07.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:07.830 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:07.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:08.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:08.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:08.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:08.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:09.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:09.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:09.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:09.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:10.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:10.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:10.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:10.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:11.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:11.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:11.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:11.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:12.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:12.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:12.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:12.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:13.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:13.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:13.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:13.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:14.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:14.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:14.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:14.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:15.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:15.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:15.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:15.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:16.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:16.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:16.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:16.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:17.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:17.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:17.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:17.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:18.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:18.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:18.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:18.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:19.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:19.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:19.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:19.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:20.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:20.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:20.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:20.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:21.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:21.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:21.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:21.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:22.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:22.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:22.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:22.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:23.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:23.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:23.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:23.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:24.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:24.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:24.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:24.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:25.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:25.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:25.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:25.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:26.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:26.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:26.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:26.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:27.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:27.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:27.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:27.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:28.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:28.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:28.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:28.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:29.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:29.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:29.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:29.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:30.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:30.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:30.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:30.834+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:31.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:31.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:31.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:31.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:32.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:32.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:32.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:32.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:33.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:33.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:33.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:33.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:34.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:34.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:34.846 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:34.861+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:35.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:35.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:35.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:35.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:36.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:36.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:36.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:36.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:37.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:37.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:37.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:37.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:38.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:38.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:38.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:38.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:39.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:39.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:39.834 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:39.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:40.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:40.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:40.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:40.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:41.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:41.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:41.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:41.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:42.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:42.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:42.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:42.889+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:43.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:43.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:43.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:43.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:44.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:44.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:44.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:44.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:45.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:45.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:45.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:45.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:46.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:46.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:46.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:46.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:47.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:47.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:47.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:47.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:48.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:48.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:48.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:48.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:49.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:49.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:49.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:49.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:50.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:50.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:50.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:50.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:51.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:51.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:51.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:51.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:52.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:52.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:52.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:52.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:53.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:53.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:53.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:53.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:54.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:54.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:54.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:54.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:55.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:55.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:55.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:55.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:56.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:56.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:56.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:56.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:57.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:57.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:57.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:57.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:58.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:58.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:58.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:58.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:59.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:09:59.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:09:59.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:09:59.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:00.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:00.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:00.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:00.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:01.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:01.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:01.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:01.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:02.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:02.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:02.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:02.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:03.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:03.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:03.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:03.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:04.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:04.722+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:04.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:04.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:05.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:05.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:05.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:05.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:06.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:06.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:06.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:06.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:07.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:07.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:07.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:07.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:08.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:08.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:08.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:08.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:09.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:09.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:09.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:09.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:10.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:10.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:10.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:10.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:11.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:11.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:11.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:11.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:12.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:12.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:12.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:12.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:13.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:13.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:13.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:13.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:14.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:14.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:14.858 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:14.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:15.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:15.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:15.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:15.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:16.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:16.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:16.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:16.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:17.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:17.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:17.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:17.861+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:18.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:18.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:18.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:18.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:19.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:19.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:19.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:19.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:20.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:20.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:20.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:20.902+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:21.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:21.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:21.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:21.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:22.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:22.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:22.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:22.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:23.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:23.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:23.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:23.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:24.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:24.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:24.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:24.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:25.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:25.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:25.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:25.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:26.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:26.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:26.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:26.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:27.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:27.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:27.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:27.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:28.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:28.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:28.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:28.957+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:29.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:29.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:29.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:29.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:30.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:30.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:30.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:30.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:31.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:31.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:31.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:31.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:32.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:32.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:32.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:32.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:33.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:33.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:33.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:33.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:34.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:34.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:34.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:34.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:35.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:35.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:35.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:35.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:36.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:36.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:36.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:36.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:37.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:37.553+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:37.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:37.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:38.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:38.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:38.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:38.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:39.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:39.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:39.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:39.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:40.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:40.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:40.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:40.875+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:41.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:41.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:41.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:41.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:42.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:42.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:42.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:42.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:43.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:43.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:43.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:43.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:44.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:44.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:44.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:44.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:45.512 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:45.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:45.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:45.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:46.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:46.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:46.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:46.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:47.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:47.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:47.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:47.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:48.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:48.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:48.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:48.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:49.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:49.536+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:49.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:49.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:50.500 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:50.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:50.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:50.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:51.522 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:51.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:51.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:51.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:52.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:52.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:52.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:52.777+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:53.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:53.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:53.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:53.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:54.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:54.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:54.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:54.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:55.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:55.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:55.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:55.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:56.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:56.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:56.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:56.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:57.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:57.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:57.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:57.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:58.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:58.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:58.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:58.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:59.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:10:59.564+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:10:59.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:10:59.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:00.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:00.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:00.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:00.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:01.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:01.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:01.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:01.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:02.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:02.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:02.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:02.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:03.497 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:03.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:03.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:03.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:04.540 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:04.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:04.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:04.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:05.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:05.526+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:05.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:05.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:06.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:06.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:06.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:06.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:07.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:07.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:07.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:07.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:08.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:08.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:08.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:08.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:09.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:09.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:09.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:09.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:10.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:10.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:10.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:10.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:11.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:11.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:11.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:11.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:12.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:12.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:12.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:12.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:13.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:13.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:13.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:13.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:14.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:14.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:14.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:14.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:15.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:15.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:15.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:15.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:16.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:16.516+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:16.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:16.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:17.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:17.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:17.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:17.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:18.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:18.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:18.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:18.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:19.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:19.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:19.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:19.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:20.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:20.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:20.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:20.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:21.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:21.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:21.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:21.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:22.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:22.602+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:22.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:22.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:23.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:23.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:23.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:23.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:24.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:24.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:24.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:24.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:25.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:25.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:25.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:25.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:26.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:26.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:26.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:26.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:27.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:27.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:27.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:27.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:28.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:28.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:28.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:28.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:29.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:29.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:29.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:29.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:30.563 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:30.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:30.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:30.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:31.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:31.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:31.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:31.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:32.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:32.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:32.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:32.702+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:33.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:33.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:33.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:33.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:34.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:34.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:34.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:34.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:35.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:35.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:35.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:35.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:36.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:36.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:36.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:36.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:37.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:37.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:37.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:37.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:38.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:38.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:38.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:38.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:39.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:39.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:39.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:39.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:40.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:40.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:40.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:40.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:41.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:41.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:41.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:41.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:42.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:42.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:42.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:42.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:43.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:43.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:43.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:43.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:44.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:44.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:44.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:44.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:45.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:45.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:45.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:45.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:46.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:46.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:46.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:46.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:47.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:47.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:47.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:47.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:48.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:48.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:48.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:48.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:49.664 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:49.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:49.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:49.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:50.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:50.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:50.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:50.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:51.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:51.674+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:51.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:51.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:52.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:52.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:52.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:52.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:53.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:53.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:53.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:53.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:54.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:54.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:54.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:54.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:55.703 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:55.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:55.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:55.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:56.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:56.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:56.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:56.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:57.727 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:57.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:57.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:57.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:58.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:58.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:58.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:58.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:59.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:11:59.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:11:59.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:11:59.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:00.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:00.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:00.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:00.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:01.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:01.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:01.847 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:01.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:02.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:02.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:02.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:02.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:03.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:03.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:03.792 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:03.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:04.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:04.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:04.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:04.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:05.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:05.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:05.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:05.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:06.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:06.715+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:06.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:06.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:07.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:07.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:07.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:07.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:08.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:08.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:08.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:08.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:09.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:09.699+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:09.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:09.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:10.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:10.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:10.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:10.935+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:11.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:11.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:11.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:11.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:12.701 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:12.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:12.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:12.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:13.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:13.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:13.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:13.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:14.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:14.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:14.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:15.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:15.759 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:15.773+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:15.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:15.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:16.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:16.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:16.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:16.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:17.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:17.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:17.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:17.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:18.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:18.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:18.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:18.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:19.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:19.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:19.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:19.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:20.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:20.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:20.916 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:20.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:21.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:21.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:21.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:21.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:22.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:22.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:22.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:22.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:23.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:23.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:23.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:23.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:24.669 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:24.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:24.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:25.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:25.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:25.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:26.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:26.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:26.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:26.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:27.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:27.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:27.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:27.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:28.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:28.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:28.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:28.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:29.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:29.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:29.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:29.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:30.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:30.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:30.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:30.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:31.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:31.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:31.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:31.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:32.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:32.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:32.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:32.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:33.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:33.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:33.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:33.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:34.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:34.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:34.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:34.671+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:35.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:35.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:35.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:35.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:36.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:36.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:36.683 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:36.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:37.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:37.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:37.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:37.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:38.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:38.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:38.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:38.787+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:38.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:38.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:39.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:39.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:39.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:40.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:40.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:40.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:41.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:41.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:41.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:41.786+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:42.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:42.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:42.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:42.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:43.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:43.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:43.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:43.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:44.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:44.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:44.785 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:44.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:45.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:45.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:45.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:45.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:46.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:46.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:46.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:46.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:47.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:47.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:47.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:47.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:48.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:48.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:48.836 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:48.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:49.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:49.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:49.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:49.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:50.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:50.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:50.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:50.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:51.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:51.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:51.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:51.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:52.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:52.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:52.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:52.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:53.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:53.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:53.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:54.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:54.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:54.129+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:54.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:54.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:55.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:55.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:55.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:55.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:56.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:56.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:56.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:57.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:57.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:57.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:57.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:58.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:58.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:58.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:59.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:12:59.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:12:59.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:12:59.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:00.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:00.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:00.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:00.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:01.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:01.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:01.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:01.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:01.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:01.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:02.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:02.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:03.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:03.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:03.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:03.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:03.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:04.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:04.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:04.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:05.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:05.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:05.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:05.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:06.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:06.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:06.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:06.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:07.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:07.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:07.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:07.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:07.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:07.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:07.992 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:08.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:08.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:08.990+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:09.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:09.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:10.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:10.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:10.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:10.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:10.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:10.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:11.051 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:11.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:11.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:11.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:12.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:12.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:12.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:12.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:13.108 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:13.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:13.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:13.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:14.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:14.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:14.927 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:14.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:15.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:15.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:15.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:15.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:16.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:16.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:16.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:16.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:17.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:17.180+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:17.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:18.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:18.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:18.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:19.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:19.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:19.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:19.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:20.007 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:20.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:20.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:20.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:21.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:21.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:21.125 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:21.137+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:21.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:22.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:22.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:22.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:22.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:22.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:23.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:23.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:24.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:24.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:24.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:24.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:25.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:25.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:25.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:25.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:26.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:26.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:26.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:26.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:27.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:27.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:27.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:27.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:28.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:28.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:28.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:28.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:29.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:29.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:29.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:29.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:30.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:30.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:30.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:30.149+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:31.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:31.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:31.158 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:31.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:32.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:32.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:32.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:32.215+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:32.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:33.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:33.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:33.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:33.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:33.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:34.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:34.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:34.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:34.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:35.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:35.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:35.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:35.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:36.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:36.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:36.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:36.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:37.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:37.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:37.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:37.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:38.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:38.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:38.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:39.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:39.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:39.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:39.966 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:39.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:40.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:40.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:40.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:40.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:41.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:41.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:41.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:41.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:42.293 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:42.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:42.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:42.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:43.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:43.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:43.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:43.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:44.276 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:44.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:44.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:44.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:45.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:45.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:46.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:46.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:46.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:46.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:46.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:46.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:47.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:47.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:48.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:48.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:48.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:48.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:49.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:49.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:49.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:49.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:50.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:50.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:50.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:50.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:51.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:51.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:51.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:51.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:52.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:52.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:52.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:52.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:53.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:53.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:53.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:53.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:54.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:54.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:54.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:54.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:55.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:55.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:55.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:55.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:56.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:56.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:56.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:56.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:57.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:57.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:57.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:57.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:57.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:58.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:58.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:58.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:59.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:13:59.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:13:59.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:13:59.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:00.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:00.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:00.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:00.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:00.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:00.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:01.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:01.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:01.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:01.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:02.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:02.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:03.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:03.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:03.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:03.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:04.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:04.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:04.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:04.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:05.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:05.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:05.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:05.292+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:05.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:05.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:06.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:06.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:06.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:06.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:07.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:07.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:07.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:07.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:08.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:08.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:08.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:08.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:09.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:09.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:09.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:09.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:10.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:10.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:10.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:10.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:11.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:11.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:11.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:11.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:12.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:12.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:12.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:12.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:13.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:13.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:13.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:13.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:14.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:14.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:14.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:14.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:15.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:15.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:15.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:15.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:16.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:16.265+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:16.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:16.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:17.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:17.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:17.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:17.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:18.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:18.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:18.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:18.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:19.137 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:19.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:19.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:19.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:20.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:20.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:20.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:20.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:21.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:21.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:21.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:21.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:22.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:22.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:22.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:22.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:23.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:23.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:24.004 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:24.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:24.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:24.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:25.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:25.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:25.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:25.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:26.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:26.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:26.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:26.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:27.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:27.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:27.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:27.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:27.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:27.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:28.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:28.095+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:28.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:28.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:29.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:29.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:29.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:29.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:30.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:30.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:30.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:30.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:31.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:31.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:31.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:31.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:32.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:32.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:32.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:32.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:33.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:33.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:33.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:33.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:34.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:34.170+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:34.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:34.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:35.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:35.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:35.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:35.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:36.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:36.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:36.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:36.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:37.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:37.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:37.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:37.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:38.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:38.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:38.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:38.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:39.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:39.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:39.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:39.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:40.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:40.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:40.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:40.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:41.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:41.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:41.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:42.004+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:42.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:42.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:42.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:42.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:43.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:43.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:43.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:43.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:44.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:44.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:44.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:44.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:45.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:45.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:45.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:45.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:46.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:46.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:46.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:47.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:47.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:47.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:47.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:47.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:48.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:48.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:48.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:48.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:49.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:49.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:49.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:49.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:50.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:50.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:50.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:50.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:51.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:51.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:51.924 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:51.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:52.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:52.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:52.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:52.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:53.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:53.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:54.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:54.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:54.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:54.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:54.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:55.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:55.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:55.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:55.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:55.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:56.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:56.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:56.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:56.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:57.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:57.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:57.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:58.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:58.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:58.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:58.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:58.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:59.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:14:59.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:14:59.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:14:59.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:00.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:00.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:00.964 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:00.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:01.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:01.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:01.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:01.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:02.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:02.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:03.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:03.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:03.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:03.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:04.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:04.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:04.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:04.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:05.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:05.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:05.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:05.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:06.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:06.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:06.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:06.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:07.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:07.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:07.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:07.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:08.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:08.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:08.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:08.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:09.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:09.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:09.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:09.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:10.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:10.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:10.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:10.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:11.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:11.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:11.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:11.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:12.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:12.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:12.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:12.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:13.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:13.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:13.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:13.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:14.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:14.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:14.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:14.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:15.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:15.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:15.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:15.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:16.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:16.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:16.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:16.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:17.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:17.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:17.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:17.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:18.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:18.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:18.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:18.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:19.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:19.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:19.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:19.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:20.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:20.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:20.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:20.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:21.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:21.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:21.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:21.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:22.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:22.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:22.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:22.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:23.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:23.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:23.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:23.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:24.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:24.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:24.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:24.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:25.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:25.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:25.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:25.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:26.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:26.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:26.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:26.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:27.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:27.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:27.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:27.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:28.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:28.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:28.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:28.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:29.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:29.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:29.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:29.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:30.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:30.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:30.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:30.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:31.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:31.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:31.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:31.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:32.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:32.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:32.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:32.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:33.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:33.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:33.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:33.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:34.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:34.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:34.371 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:34.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:35.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:35.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:35.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:35.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:36.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:36.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:36.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:36.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:37.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:37.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:37.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:37.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:38.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:38.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:38.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:38.332+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:39.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:39.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:39.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:39.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:40.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:40.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:40.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:40.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:41.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:41.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:41.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:41.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:42.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:42.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:42.270 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:42.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:43.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:43.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:43.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:43.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:44.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:44.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:44.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:44.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:45.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:45.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:45.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:45.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:46.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:46.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:46.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:46.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:47.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:47.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:47.260 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:47.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:48.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:48.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:48.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:48.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:49.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:49.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:49.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:49.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:50.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:50.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:50.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:50.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:51.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:51.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:51.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:51.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:52.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:52.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:52.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:52.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:53.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:53.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:53.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:53.341+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:54.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:54.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:54.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:54.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:55.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:55.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:55.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:55.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:56.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:56.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:56.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:56.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:57.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:57.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:57.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:57.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:58.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:58.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:58.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:58.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:59.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:15:59.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:15:59.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:15:59.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:00.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:00.076+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:00.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:00.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:01.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:01.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:01.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:01.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:02.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:02.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:02.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:02.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:03.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:03.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:03.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:03.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:04.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:04.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:04.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:04.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:05.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:05.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:05.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:05.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:06.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:06.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:06.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:06.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:07.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:07.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:07.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:07.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:08.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:08.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:08.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:08.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:08.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:09.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:09.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:09.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:09.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:09.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:10.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:10.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:10.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:10.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:11.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:11.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:11.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:11.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 138 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:12.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:12.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:12.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:12.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:13.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:13.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:13.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:13.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:14.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:14.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:14.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:14.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:15.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:15.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:15.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:15.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:16.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:16.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:16.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:16.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:17.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:17.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:17.892 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:17.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:18.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:18.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:18.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:18.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:19.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:19.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:19.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:19.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:20.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:20.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:20.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:20.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:21.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:21.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:21.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:21.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:22.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:22.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:22.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:22.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:23.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:23.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:23.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:23.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:24.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:24.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:24.860 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:24.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:25.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:25.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:25.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:25.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:26.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:26.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:26.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:26.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:27.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:27.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:27.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:27.921+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:28.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:28.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:28.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:28.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:29.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:29.727+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:29.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:30.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:30.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:30.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:31.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:31.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:31.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:31.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:32.029 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:32.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:32.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:32.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:33.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:33.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:33.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:33.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:34.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:34.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:34.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:34.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:35.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:35.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:35.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:35.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:36.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:36.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:36.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:36.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:37.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:37.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:37.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:37.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:38.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:38.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:38.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:38.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:39.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:39.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:39.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:39.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:40.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:40.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:40.771 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:40.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:41.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:41.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:41.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:41.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:42.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:42.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 110 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:42.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:42.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:43.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:43.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:43.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:43.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:44.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:44.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:44.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:44.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:45.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:45.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:45.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:45.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:46.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:46.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:46.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:46.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:47.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:47.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:47.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:47.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:48.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:48.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:48.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:48.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:49.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:49.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:49.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:49.797+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:50.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:50.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:50.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:50.773+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:51.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:51.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:51.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:51.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:52.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:52.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:52.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:52.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:53.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:53.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:53.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:53.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:54.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:54.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:54.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:54.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:55.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:55.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:55.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:55.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:56.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:56.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:56.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:56.811+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:57.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:57.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:57.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:57.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:58.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:58.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:58.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:58.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:59.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:16:59.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:16:59.745 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:16:59.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:00.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:00.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:00.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:00.751+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:01.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:01.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:01.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:01.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:02.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:02.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:02.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:02.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:03.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:03.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:03.738 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:03.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:04.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:04.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:04.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:04.739+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:05.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:05.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:05.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:05.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:06.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:06.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:06.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:06.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:07.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:07.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:07.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:07.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:08.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:08.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:08.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:08.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:09.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:09.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:09.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:09.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:10.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:10.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:10.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:10.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:11.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:11.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:11.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:11.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:12.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:12.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:12.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:12.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:13.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:13.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:13.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:13.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:14.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:14.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:14.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:14.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:15.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:15.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:15.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:15.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:16.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:16.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:16.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:16.764+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:17.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:17.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:17.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:17.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:18.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:18.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:18.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:18.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:19.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:19.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:19.763 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:19.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:20.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:20.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:20.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:20.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:21.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:21.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:21.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:21.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:22.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:22.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:22.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:22.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:23.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:23.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:23.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:23.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:24.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:24.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:24.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:24.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:25.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:25.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:25.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:25.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:26.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:26.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:26.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:26.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:27.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:27.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:27.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:27.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:28.113 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:28.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:28.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:28.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:29.091 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:29.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:29.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:29.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:30.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:30.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:30.873 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:30.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:31.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:31.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:31.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:31.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:32.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:32.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:32.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:32.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:33.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:33.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:33.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:33.972+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:34.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:34.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:34.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:34.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:35.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:35.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:36.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:36.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:36.081 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:36.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:36.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:36.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:37.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:37.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:37.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:37.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:38.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:38.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:38.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:38.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:39.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:39.090+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:39.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:39.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:40.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:40.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:40.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:40.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:41.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:41.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:41.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:41.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:42.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:42.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:42.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:42.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:43.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:43.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:43.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:43.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:44.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:44.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:44.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:44.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:45.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:45.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:45.876 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:45.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:46.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:46.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:46.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:46.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:47.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:47.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:47.874 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:47.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:48.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:48.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:48.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:48.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:49.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:49.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:49.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:49.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:50.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:50.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:50.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:50.850+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:51.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:51.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:51.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:51.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:52.120 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:52.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:52.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:52.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:53.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:53.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:53.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:53.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:54.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:54.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:54.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:54.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:55.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:55.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:55.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:55.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:56.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:56.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:56.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:56.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:57.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:57.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:57.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:57.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:58.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:58.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:58.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:58.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:59.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:17:59.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:17:59.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:17:59.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:00.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:00.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:00.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:00.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:01.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:01.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:01.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:01.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:02.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:02.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:02.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:02.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:03.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:03.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:03.576 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:03.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:04.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:04.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:04.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:04.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:05.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:05.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:05.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:05.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:06.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:06.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:06.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:06.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:07.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:07.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:07.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:07.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:08.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:08.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:08.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:08.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:09.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:09.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:09.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:09.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:10.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:10.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:10.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:10.725+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:11.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:11.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:11.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:11.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:12.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:12.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:12.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:12.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:13.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:13.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:13.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:13.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:14.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:14.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:14.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:14.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:15.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:15.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:15.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:15.846+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:16.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:16.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:16.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:16.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:17.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:17.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:17.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:17.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:18.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:18.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:18.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:18.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:19.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:19.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:19.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:19.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:20.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:20.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:20.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:20.849+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:21.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:21.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:21.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:21.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:22.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:22.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:22.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:22.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:23.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:23.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:23.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:23.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:24.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:24.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:24.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:24.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:25.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:25.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:25.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:25.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:26.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:26.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:26.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:26.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:27.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:27.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:27.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:27.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:28.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:28.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:28.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:28.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:29.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:29.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:29.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:29.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:30.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:30.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:30.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:30.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:31.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:31.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:31.854 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:31.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:32.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:32.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:32.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:32.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:33.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:33.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:33.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:33.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:34.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:34.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:34.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:34.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:35.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:35.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:35.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:35.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:36.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:36.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:36.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:36.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:37.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:37.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:37.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:37.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:38.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:38.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:38.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:38.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:39.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:39.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:39.856 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:39.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:40.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:40.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:40.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:40.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:41.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:41.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:41.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:41.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:42.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:42.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:42.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:42.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:43.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:43.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:43.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:43.874+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:44.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:44.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:44.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:44.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:45.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:45.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:45.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:45.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:46.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:46.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:46.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:46.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:47.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:47.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:47.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:47.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:48.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:48.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:48.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:48.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:49.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:49.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:49.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:49.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:50.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:50.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:50.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:50.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:51.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:51.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:51.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:51.931+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:52.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:52.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:52.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:52.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:53.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:53.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:53.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:53.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:54.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:54.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:54.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:54.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:55.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:55.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:55.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:55.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:56.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:56.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:56.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:56.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:57.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:57.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:57.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:57.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:58.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:58.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:58.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:58.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:59.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:18:59.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:18:59.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:18:59.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:00.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:00.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:00.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:00.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:01.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:01.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:01.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:01.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:02.473 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:02.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:03.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:03.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:03.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:03.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:03.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:04.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:04.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:04.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:05.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:05.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:05.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:05.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:06.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:06.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:06.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:06.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:07.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:07.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:07.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:07.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:07.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:07.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:08.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:08.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:08.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:08.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:09.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:09.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:10.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:10.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:10.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:10.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:10.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:11.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:11.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:11.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:12.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:12.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:12.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:12.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:13.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:13.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:13.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:13.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:14.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:14.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:14.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:14.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:15.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:15.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:15.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:15.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:16.098 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:16.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:16.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:16.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:17.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:17.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:17.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:17.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:18.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:18.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:18.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:18.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:19.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:19.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:19.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:19.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:20.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:20.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:20.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:20.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:21.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:21.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:21.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:21.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:22.134 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:22.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:22.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:22.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:23.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:23.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:23.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:23.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:24.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:24.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:24.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:24.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:25.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:25.208+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:25.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:25.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:26.184 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:26.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:26.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:26.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:27.156 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:27.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:27.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:27.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:28.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:28.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:28.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:28.370+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:29.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:29.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:29.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:29.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:30.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:30.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:30.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:30.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:31.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:31.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:31.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:31.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:32.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:32.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:32.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:32.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:33.176 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:33.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:33.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:33.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:34.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:34.155+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:34.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:34.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:35.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:35.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:35.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:35.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:36.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:36.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:36.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:36.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:37.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:37.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:37.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:37.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:38.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:38.090+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:38.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:38.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:39.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:39.109+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:39.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:39.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:40.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:40.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:40.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:40.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:41.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:41.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:41.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:41.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:41.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:41.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:42.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:42.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:42.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:42.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:43.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:43.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:43.959 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:43.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:44.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:44.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:44.972 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:44.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:45.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:45.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:45.956 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:45.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:46.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:46.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:46.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:46.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:47.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:47.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:47.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:47.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:48.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:48.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:48.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:48.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:49.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:49.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:50.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:50.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:50.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:50.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:51.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:51.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:51.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:51.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:52.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:52.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:52.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:52.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:53.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:53.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:53.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:53.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:54.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:54.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:54.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:54.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:55.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:55.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:55.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:55.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:56.095 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:56.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:56.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:56.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:57.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:57.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:57.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:57.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:58.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:58.144+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:58.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:58.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:59.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:19:59.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:19:59.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:19:59.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:00.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:00.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:00.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:00.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:01.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:01.171+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:01.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:01.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:02.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:02.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:02.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:02.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:03.187 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:03.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:03.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:03.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:04.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:04.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:04.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:04.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:05.240 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:05.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:05.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:05.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:06.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:06.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:06.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:06.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:07.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:07.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:07.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:07.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:08.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:08.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:08.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:08.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:09.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:09.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:09.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:09.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:10.252 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:10.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:10.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:10.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:11.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:11.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:11.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:11.290+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:12.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:12.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:12.264 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:12.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:13.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:13.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:13.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:13.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:14.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:14.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:14.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:14.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:15.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:15.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:15.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:15.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:16.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:16.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:16.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:16.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:17.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:17.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:17.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:17.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:18.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:18.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:18.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:18.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:19.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:19.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:19.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:19.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:20.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:20.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:20.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:20.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:21.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:21.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:21.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:21.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:22.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:22.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:22.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:22.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:23.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:23.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:23.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:23.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:24.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:24.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:24.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:24.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:25.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:25.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:25.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:25.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:26.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:26.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:26.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:26.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:27.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:27.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:27.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:27.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:28.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:28.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:28.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:28.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:29.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:29.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:29.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:29.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:30.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:30.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:30.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:30.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:31.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:31.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:31.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:31.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:32.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:32.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:32.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:32.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:33.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:33.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:33.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:33.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:34.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:34.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:34.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:34.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:35.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:35.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:35.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:35.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:36.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:36.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:36.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:36.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:37.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:37.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:37.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:37.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:38.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:38.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:38.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:38.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:39.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:39.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:39.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:39.233+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:40.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:40.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:40.257 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:40.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:41.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:41.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:41.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:41.302+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:42.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:42.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:42.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:42.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:43.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:43.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:43.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:43.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:44.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:44.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:44.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:44.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:45.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:45.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:45.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:45.352+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:46.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:46.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:46.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:46.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:47.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:47.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:47.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:47.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:48.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:48.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:48.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:48.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:49.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:49.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:49.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:49.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:50.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:50.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:50.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:50.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:51.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:51.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:51.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:51.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:52.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:52.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:52.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:52.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:53.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:53.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:53.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:53.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:54.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:54.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:54.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:54.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:55.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:55.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:55.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:55.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:56.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:56.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:56.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:56.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:57.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:57.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:57.351 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:57.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:58.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:58.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:58.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:58.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:59.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:20:59.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:20:59.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:20:59.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:00.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:00.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:00.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:00.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:01.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:01.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:01.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:01.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:02.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:02.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:02.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:02.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:03.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:03.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:03.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:03.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:04.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:04.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:04.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:04.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:05.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:05.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:05.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:05.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:06.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:06.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:06.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:06.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:07.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:07.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:07.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:07.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:08.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:08.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:08.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:08.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:09.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:09.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:09.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:09.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:10.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:10.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:10.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:10.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:11.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:11.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:11.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:11.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:12.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:12.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:12.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:12.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:13.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:13.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:13.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:13.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:14.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:14.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:14.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:14.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:15.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:15.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:15.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:15.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:16.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:16.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:16.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:16.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:17.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:17.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:17.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:17.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:18.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:18.269+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:18.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:18.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:19.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:19.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:19.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:19.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:20.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:20.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:20.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:20.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:21.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:21.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:21.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:21.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:22.291 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:22.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:22.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:22.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:23.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:23.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:23.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:23.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:24.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:24.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:24.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:24.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:25.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:25.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:25.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:25.281+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:26.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:26.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:26.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:26.284+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:27.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:27.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:27.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:27.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:28.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:28.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:28.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:28.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:29.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:29.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:29.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:29.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:30.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:30.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:30.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:30.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:31.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:31.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:31.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:31.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:32.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:32.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:32.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:32.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:33.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:33.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:33.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:33.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:34.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:34.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:34.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:34.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:35.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:35.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:35.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:35.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:36.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:36.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:36.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:36.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:37.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:37.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:37.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:37.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:38.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:38.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:38.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:38.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:39.232 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:39.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:39.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:39.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:40.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:40.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:40.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:40.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:41.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:41.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:41.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:41.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:42.214 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:42.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:42.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:42.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:43.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:43.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:43.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:43.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:44.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:44.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:44.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:44.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:45.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:45.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:45.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:45.489+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:46.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:46.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:46.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:46.475+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:47.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:47.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:47.476 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:47.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:48.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:48.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:48.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:48.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:49.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:49.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:49.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:49.420+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:50.273 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:50.278+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:50.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:50.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:51.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:51.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:51.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:51.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:52.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:52.275+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:52.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:52.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:53.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:53.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:53.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:53.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:54.272 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:54.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:54.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:54.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:55.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:55.273+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:55.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:55.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:56.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:56.289+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:56.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:56.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:57.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:57.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:57.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:57.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:58.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:58.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:58.488 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:58.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:59.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:21:59.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:21:59.494 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:21:59.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:00.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:00.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:00.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:00.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:01.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:01.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:01.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:01.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:02.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:02.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:02.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:02.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:03.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:03.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:03.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:03.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:04.279 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:04.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:04.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:04.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:05.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:05.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:05.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:05.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:06.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:06.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:06.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:06.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:07.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:07.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:07.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:07.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:08.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:08.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:08.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:08.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:09.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:09.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:09.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:09.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:10.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:10.253+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:10.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:10.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:11.290 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:11.293+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:11.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:11.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:12.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:12.280+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:12.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:12.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:13.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:13.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:13.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:13.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:14.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:14.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:14.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:14.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:15.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:15.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:15.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:15.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:16.226 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:16.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:16.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:16.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:17.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:17.254+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:17.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:17.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:18.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:18.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:18.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:18.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:19.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:19.244+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:19.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:19.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:20.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:20.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:20.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:20.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:21.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:21.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:21.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:21.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:22.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:22.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:22.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:22.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:23.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:23.135+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:23.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:23.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:24.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:24.138+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:24.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:24.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:25.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:25.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:25.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:25.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:26.105 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:26.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:26.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:26.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:27.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:27.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:27.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:27.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:28.130 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:28.133+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:28.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:28.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:29.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:29.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:29.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:29.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:30.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:30.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:30.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:30.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:31.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:31.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:31.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:31.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:32.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:32.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:32.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:32.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:33.220 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:33.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:33.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:33.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:34.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:34.216+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:34.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:34.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:35.215 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:35.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:35.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:35.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:36.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:36.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:36.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:36.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:37.209 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:37.212+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:37.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:37.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:38.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:38.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:38.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:38.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:39.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:39.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:39.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:39.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:40.193 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:40.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:40.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:40.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:41.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:41.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:41.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:41.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:42.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:42.164+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:42.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:42.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:43.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:43.148+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:43.359 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:43.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:44.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:44.102+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:44.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:44.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:45.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:45.116+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:45.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:45.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:46.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:46.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:46.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:46.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:47.065 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:47.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:47.380 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:47.383+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:48.075 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:48.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:48.331 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:48.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:49.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:49.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:49.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:49.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:50.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:50.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:50.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:50.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:51.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:51.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:51.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:51.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:52.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:52.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:52.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:52.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:53.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:53.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:53.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:53.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:54.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:54.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:54.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:54.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:54.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:54.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:55.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:55.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:55.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:55.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:56.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:56.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:56.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:56.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:57.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:57.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:57.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:57.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:58.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:58.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:58.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:22:58.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:22:59.398 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:22:59.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:00.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:00.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:00.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:00.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:00.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:00.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:01.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:01.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:02.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:02.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:02.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:02.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:02.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:02.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:03.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:03.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:04.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:04.022+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:04.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:04.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:05.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:05.059+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:05.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:05.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:06.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:06.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:06.420 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:06.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:07.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:07.104+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:07.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:07.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:08.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:08.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:08.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:08.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:09.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:09.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:09.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:09.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:10.148 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:10.152+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:10.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:10.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:11.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:11.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:11.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:11.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:12.124 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:12.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:12.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:12.372+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:13.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:13.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:13.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:13.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:14.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:14.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:14.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:14.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:15.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:15.210+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:15.452 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:15.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:16.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:16.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:16.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:16.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:17.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:17.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:17.390 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:17.393+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:18.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:18.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:18.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:18.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:19.164 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:19.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:19.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:19.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:20.170 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:20.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:20.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:20.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:21.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:21.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:21.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:21.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:22.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:22.186+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:22.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:22.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:23.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:23.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:23.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:23.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:24.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:24.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:24.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:24.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:25.180 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:25.184+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:25.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:25.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:26.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:26.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:26.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:26.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:27.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:27.224+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:27.376 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:27.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:28.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:28.261+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:28.392 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:28.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:29.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:29.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:29.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:29.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:30.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:30.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:30.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:30.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:31.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:31.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:31.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:31.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:32.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:32.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:32.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:32.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:33.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:33.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:33.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:33.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:34.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:34.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:34.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:34.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:35.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:35.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:35.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:35.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:36.234 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:36.236+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:36.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:36.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:37.208 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:37.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:37.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:37.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:38.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:38.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:38.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:38.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:39.237 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:39.239+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:39.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:39.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:40.218 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:40.220+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:40.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:40.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:41.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:41.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:41.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:41.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:42.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:42.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:42.274 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:42.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:43.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:43.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:43.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:43.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:44.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:44.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:44.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:44.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:45.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:45.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:45.280 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:45.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:46.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:46.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:46.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:46.285+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:47.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:47.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:47.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:47.322+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:48.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:48.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:48.340 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:48.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:49.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:49.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:49.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:49.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:50.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:50.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:50.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:50.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:51.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:51.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:51.400 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:51.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:52.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:52.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:52.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:52.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:53.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:53.318+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:53.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:53.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:54.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:54.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:54.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:54.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:55.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:55.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:55.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:55.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:56.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:56.336+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:56.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:56.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:57.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:57.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:57.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:57.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:58.374 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:58.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:58.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:58.390+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:59.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:23:59.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:23:59.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:23:59.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:00.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:00.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:00.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:00.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:01.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:01.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:01.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:01.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:02.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:02.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:02.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:02.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:03.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:03.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:03.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:03.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:04.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:04.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:04.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:04.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:05.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:05.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:05.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:05.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:06.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:06.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:06.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:06.457+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:07.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:07.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:07.424 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:07.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:08.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:08.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:08.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:08.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:09.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:09.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:09.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:09.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:10.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:10.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:10.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:10.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:11.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:11.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:11.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:11.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:12.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:12.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:12.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:12.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:13.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:13.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:13.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:13.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:14.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:14.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:14.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:14.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:15.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:15.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:15.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:15.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:16.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:16.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:16.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:16.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:17.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:17.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:17.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:17.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:18.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:18.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:18.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:18.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:19.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:19.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:19.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:19.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:20.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:20.406+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:20.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:20.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:21.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:21.452+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:21.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:21.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:22.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:22.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:22.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:22.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:22.826 INFO:tasks.workunit.client.0.smithi037.stderr:2023-07-23T02:24:22.829+0000 7f81c8bec700 0 -- 172.21.15.37:0/3674447020 >> [v2:172.21.15.37:6800/96726,v1:172.21.15.37:6801/96726] conn(0x7f81a8004bb0 msgr2=0x7f81ac0ca6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-07-23T02:24:23.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:23.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:23.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:23.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:24.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:24.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:24.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:24.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:25.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:25.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:25.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:25.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:26.384 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:26.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:26.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:26.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:27.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:27.401+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:27.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:27.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:28.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:28.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:28.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:28.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:29.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:29.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:29.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:29.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:30.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:30.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:30.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:30.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:31.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:31.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:31.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:31.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:32.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:32.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:32.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:32.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:33.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:33.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:33.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:33.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:34.416 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:34.419+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:34.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:34.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:35.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:35.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:35.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:35.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:36.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:36.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:36.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:36.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:37.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:37.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:37.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:37.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:38.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:38.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:38.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:38.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:39.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:39.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:39.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:39.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:40.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:40.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:40.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:40.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:41.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:41.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:41.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:41.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:42.381 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:42.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:42.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:42.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:43.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:43.433+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:43.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:43.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:44.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:44.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:44.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:44.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:45.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:45.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:45.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:45.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:46.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:46.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:46.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:46.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:47.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:47.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:47.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:47.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:48.470 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:48.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:48.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:48.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:49.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:49.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:49.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:49.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:50.434 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:50.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:50.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:50.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:51.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:51.409+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:51.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:51.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:52.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:52.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:52.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:52.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:53.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:53.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:53.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:53.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:54.408 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:54.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:54.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:54.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:55.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:55.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:55.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:55.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:56.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:56.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:56.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:56.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:57.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:57.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:57.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:57.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:58.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:58.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:58.544 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:58.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:59.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:24:59.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:24:59.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:24:59.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:00.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:00.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:00.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:00.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:01.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:01.417+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:01.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:01.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:02.429 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:02.431+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:02.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:02.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:03.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:03.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:03.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:03.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:04.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:04.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:04.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:04.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:05.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:05.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:05.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:05.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:06.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:06.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:06.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:06.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:07.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:07.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:07.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:07.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:08.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:08.411+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:08.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:08.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:09.419 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:09.421+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:09.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:09.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:10.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:10.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:10.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:10.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:11.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:11.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:11.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:11.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:12.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:12.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:12.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:12.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:13.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:13.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:13.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:13.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:14.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:14.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:14.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:14.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:15.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:15.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:15.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:15.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:16.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:16.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:16.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:16.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:17.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:17.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:17.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:17.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:18.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:18.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:18.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:18.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:19.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:19.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:19.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:19.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:20.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:20.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:20.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:20.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:21.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:21.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:21.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:21.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:22.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:22.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:22.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:22.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:23.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:23.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:23.751 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:23.753+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:24.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:24.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:24.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:24.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:25.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:25.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:25.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:25.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:26.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:26.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:26.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:26.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:27.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:27.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:27.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:27.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:28.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:28.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:28.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:28.787+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:29.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:29.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:29.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:29.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:30.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:30.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:30.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:30.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:31.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:31.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:31.764 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:31.766+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:32.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:32.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:32.787 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:32.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:33.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:33.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:33.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:33.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:34.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:34.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:34.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:34.763+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:35.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:35.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:35.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:35.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:36.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:36.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:36.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:36.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:37.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:37.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:37.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:37.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:38.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:38.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:38.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:38.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:39.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:39.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:39.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:39.887+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:40.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:40.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:40.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:40.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:41.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:41.397+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:41.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:41.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:42.426 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:42.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:42.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:42.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:43.428 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:43.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:43.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:43.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:44.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:44.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:44.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:44.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:45.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:45.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:45.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:45.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:46.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:46.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:46.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:46.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:47.370 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:47.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:47.786 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:47.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:48.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:48.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:48.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:48.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:49.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:49.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:49.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:49.857+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:50.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:50.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:50.818 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:50.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:51.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:51.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:51.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:51.819+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:52.410 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:52.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:52.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:52.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:53.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:53.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:53.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:53.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:54.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:54.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:54.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:54.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:55.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:55.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:55.800 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:55.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:56.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:56.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:56.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:56.833+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:57.372 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:57.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:57.798 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:57.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:58.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:58.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:58.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:58.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:59.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:25:59.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:25:59.758 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:25:59.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:00.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:00.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:00.772 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:00.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:01.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:01.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:01.776 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:01.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:02.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:02.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:02.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:02.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:03.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:03.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:03.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:03.771+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:04.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:04.449+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:04.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:04.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:05.455 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:05.456+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:05.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:05.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:06.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:06.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:06.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:06.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:07.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:07.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:07.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:07.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:08.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:08.509+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:08.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:08.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:09.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:09.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:09.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:09.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:10.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:10.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:10.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:10.747+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:11.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:11.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:11.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:11.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:12.536 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:12.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:12.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:12.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:13.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:13.498+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:13.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:13.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:14.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:14.486+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:14.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:14.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:15.459 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:15.460+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:15.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:15.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:16.475 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:16.477+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:16.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:16.674+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:17.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:17.497+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:17.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:17.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:18.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:18.487+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:18.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:18.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:19.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:19.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:19.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:19.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:20.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:20.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:20.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:20.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:21.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:21.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:21.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:21.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:22.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:22.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:22.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:22.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:23.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:23.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:23.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:23.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:24.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:24.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:24.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:24.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:25.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:25.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:25.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:25.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:26.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:26.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:26.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:26.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:27.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:27.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:27.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:27.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:28.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:28.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:28.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:28.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:29.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:29.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:29.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:29.598+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:30.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:30.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:30.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:30.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:31.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:31.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:31.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:31.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:32.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:32.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:32.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:32.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:33.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:33.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:33.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:33.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:34.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:34.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:34.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:34.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:35.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:35.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:35.550 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:35.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:36.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:36.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:36.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:36.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:37.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:37.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:37.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:37.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:38.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:38.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:38.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:38.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:39.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:39.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:39.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:39.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:40.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:40.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:40.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:40.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:41.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:41.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:41.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:41.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:42.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:42.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:42.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:42.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:43.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:43.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:43.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:43.581+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:44.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:44.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:44.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:44.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:45.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:45.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:45.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:45.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:46.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:46.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:46.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:46.620+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:47.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:47.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:47.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:47.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:48.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:48.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:48.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:48.571+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:49.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:49.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:49.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:49.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:50.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:50.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:50.547 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:50.550+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:51.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:51.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:51.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:51.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:52.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:52.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:52.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:52.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:53.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:53.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:53.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:53.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:54.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:54.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:54.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:54.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:55.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:55.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:55.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:55.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:56.496 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:56.499+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:56.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:56.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:57.526 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:57.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:57.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:57.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:58.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:58.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:58.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:58.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:59.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:26:59.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:26:59.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:26:59.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:00.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:00.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:00.615 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:00.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:01.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:01.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:01.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:01.589+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:02.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:02.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:02.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:02.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:03.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:03.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:03.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:03.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:04.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:04.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:04.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:04.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:05.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:05.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:05.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:05.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:06.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:06.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:06.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:06.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:07.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:07.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:07.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:07.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:08.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:08.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:08.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:08.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:09.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:09.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:09.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:09.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:10.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:10.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:10.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:10.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:11.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:11.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:11.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:11.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:12.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:12.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:12.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:12.701+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:13.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:13.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:13.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:13.742+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:14.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:14.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:14.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:14.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:15.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:15.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:15.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:15.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:16.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:16.421+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:16.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:16.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:17.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:17.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:17.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:17.704+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:18.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:18.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:18.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:18.656+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:19.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:19.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:19.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:19.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:20.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:20.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:20.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:20.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:21.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:21.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:21.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:21.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:22.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:22.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:22.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:22.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:23.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:23.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:23.662 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:23.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:24.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:24.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:24.646 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:24.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:25.347 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:25.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:25.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:25.668+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:26.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:26.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:26.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:26.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:27.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:27.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:27.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:27.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:28.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:28.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:28.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:28.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:29.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:29.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:29.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:29.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:30.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:30.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:30.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:30.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:31.352 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:31.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:31.744 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:31.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:32.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:32.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:32.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:32.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:33.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:33.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:33.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:33.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:34.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:34.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:34.786 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:34.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:35.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:35.358+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:35.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:35.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:36.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:36.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:36.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:36.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:37.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:37.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:37.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:37.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:38.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:38.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:38.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:38.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:39.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:39.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:39.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:39.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:40.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:40.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:40.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:40.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:41.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:41.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:41.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:41.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:42.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:42.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:42.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:42.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:43.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:43.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:43.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:43.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:44.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:44.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:44.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:44.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:45.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:45.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:45.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:45.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:46.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:46.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:46.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:46.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:47.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:47.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:47.832 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:47.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:48.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:48.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:48.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:48.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:49.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:49.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:49.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:49.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:50.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:50.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:50.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:50.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:51.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:51.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:51.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:51.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:52.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:52.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:52.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:52.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:53.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:53.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:53.829 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:53.830+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:54.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:54.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:54.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:54.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:55.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:55.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:55.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:55.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:56.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:56.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:56.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:56.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:57.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:57.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:57.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:57.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:58.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:58.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:58.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:58.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:59.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:27:59.454+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:27:59.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:27:59.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:00.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:00.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:00.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:00.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:01.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:01.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:01.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:01.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:02.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:02.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:02.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:02.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:03.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:03.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:03.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:03.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:04.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:04.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:04.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:04.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:05.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:05.490+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:05.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:05.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:06.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:06.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:06.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:06.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:07.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:07.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:07.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:07.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:08.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:08.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:08.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:08.903+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:09.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:09.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:09.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:09.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:10.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:10.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:10.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:10.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:11.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:11.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:11.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:11.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:12.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:12.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:12.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:12.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:13.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:13.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:13.957 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:13.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:14.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:14.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:15.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:15.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:15.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:15.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:15.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:15.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:16.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:16.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:16.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:17.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:17.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:17.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:17.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:17.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:18.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:18.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:18.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:18.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:19.603 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:19.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:19.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:19.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:20.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:20.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:20.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:20.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:21.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:21.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:21.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:21.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:22.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:22.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:22.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:22.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:23.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:23.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:23.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:23.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:24.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:24.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:24.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:24.831+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:25.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:25.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:25.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:25.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:26.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:26.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:26.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:26.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:27.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:27.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:27.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:27.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:28.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:28.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:28.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:28.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:29.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:29.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:29.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:29.833+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:30.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:30.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:30.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:30.824+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:31.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:31.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:31.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:31.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:32.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:32.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:32.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:32.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:33.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:33.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:33.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:33.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:34.657 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:34.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:34.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:34.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:35.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:35.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:35.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:35.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:36.586 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:36.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:36.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:36.764+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:37.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:37.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:37.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:37.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:38.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:38.608+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:38.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:38.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:39.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:39.589+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:39.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:39.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:40.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:40.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:40.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:40.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:41.518 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:41.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:41.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:41.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:42.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:42.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:42.776 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:42.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:43.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:43.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:43.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:43.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:44.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:44.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:44.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:44.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:45.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:45.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:45.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:45.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:46.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:46.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:46.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:46.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:47.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:47.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:47.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:47.752+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:48.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:48.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:48.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:48.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:49.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:49.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:49.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:49.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:50.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:50.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:50.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:50.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:51.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:51.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:51.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:51.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:52.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:52.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:52.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:52.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:53.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:53.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:53.801 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:53.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:54.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:54.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:54.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:54.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:55.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:55.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:55.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:55.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:56.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:56.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:56.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:56.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:57.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:57.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:57.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:57.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:58.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:58.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:58.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:58.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:59.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:28:59.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:28:59.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:28:59.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:00.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:00.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:00.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:00.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:01.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:01.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:01.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:01.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:02.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:02.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:02.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:02.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:03.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:03.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:03.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:03.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:04.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:04.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:04.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:04.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:05.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:05.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:05.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:05.771+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:06.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:06.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:06.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:06.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:07.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:07.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:07.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:07.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:08.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:08.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:08.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:08.760+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:09.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:09.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:09.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:09.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:10.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:10.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:10.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:10.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:11.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:11.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:11.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:11.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:12.418 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:12.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:12.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:12.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:13.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:13.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:13.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:13.733+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:14.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:14.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:14.725 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:14.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:15.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:15.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:15.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:15.682+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:16.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:16.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:16.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:16.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:17.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:17.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:17.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:17.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:18.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:18.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:18.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:18.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:19.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:19.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:19.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:19.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:20.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:20.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:20.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:20.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:21.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:21.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:21.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:21.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:22.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:22.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:22.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:22.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:23.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:23.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:23.787 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:23.789+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:24.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:24.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:24.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:24.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:25.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:25.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:25.772 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:25.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:26.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:26.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:26.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:26.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:27.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:27.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:27.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:27.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:28.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:28.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:28.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:28.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:29.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:29.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:29.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:29.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:30.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:30.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:30.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:30.688+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:31.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:31.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:31.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:31.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:32.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:32.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:32.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:32.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:33.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:33.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:33.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:33.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:34.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:34.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:34.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:34.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:35.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:35.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:35.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:35.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:36.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:36.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:36.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:36.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:37.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:37.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:37.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:37.591+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:38.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:38.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:38.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:38.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:39.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:39.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:39.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:39.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:40.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:40.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:40.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:40.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:41.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:41.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:41.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:41.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:42.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:42.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:42.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:42.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:43.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:43.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:43.555 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:43.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:44.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:44.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:44.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:44.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:45.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:45.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:45.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:45.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:46.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:46.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:46.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:46.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:47.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:47.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:47.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:47.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:48.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:48.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:48.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:48.654+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:49.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:49.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:49.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:49.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:50.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:50.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:50.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:50.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:51.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:51.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:51.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:51.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:52.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:52.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:52.700 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:52.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:53.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:53.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:53.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:53.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:54.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:54.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:54.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:54.753+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:55.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:55.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:55.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:55.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:56.487 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:56.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:56.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:56.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:57.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:57.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:57.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:57.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:58.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:58.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:58.838 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:58.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:59.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:29:59.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:29:59.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:29:59.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:00.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:00.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:00.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:00.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:01.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:01.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:01.855 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:01.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:02.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:02.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:02.866 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:02.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:03.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:03.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:03.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:03.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:04.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:04.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:04.882 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:04.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:05.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:05.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:05.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:05.887+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:06.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:06.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:06.851 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:06.852+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:07.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:07.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:07.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:07.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:08.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:08.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:08.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:08.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:09.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:09.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:09.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:09.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:10.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:10.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:10.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:10.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:11.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:11.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:11.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:11.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:12.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:12.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:12.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:12.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:13.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:13.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:13.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:13.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:14.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:14.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:14.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:14.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:15.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:15.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:15.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:15.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:16.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:16.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:16.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:16.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:17.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:17.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:17.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:17.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:18.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:18.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:18.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:18.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:19.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:19.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:19.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:19.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:20.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:20.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:20.755 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:20.756+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:21.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:21.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:21.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:21.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:22.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:22.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:22.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:22.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:23.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:23.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:23.754 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:23.755+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:24.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:24.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:24.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:24.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:25.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:25.576+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:25.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:25.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:26.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:26.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:26.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:26.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:27.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:27.510+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:27.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:27.719+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:28.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:28.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:28.709 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:28.710+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:29.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:29.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:29.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:29.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:30.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:30.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:30.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:30.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:31.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:31.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:31.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:31.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:32.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:32.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:32.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:32.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:33.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:33.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:33.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:33.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:34.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:34.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:34.667 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:34.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:35.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:35.523+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:35.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:35.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:36.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:36.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:36.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:36.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:37.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:37.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:37.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:37.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:38.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:38.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:38.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:38.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:39.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:39.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:39.695 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:39.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:40.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:40.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:40.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:40.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:41.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:41.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:41.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:41.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:42.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:42.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:42.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:42.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:43.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:43.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:43.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:43.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:44.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:44.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:44.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:44.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:45.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:45.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:45.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:45.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:46.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:46.518+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:46.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:46.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:47.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:47.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:47.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:47.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:48.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:48.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:48.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:48.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:49.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:49.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:49.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:49.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:50.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:50.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:50.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:50.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:51.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:51.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:51.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:51.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:52.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:52.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:52.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:52.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:53.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:53.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:53.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:53.839+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:54.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:54.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:54.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:54.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:55.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:55.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:55.812 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:55.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:56.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:56.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:56.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:56.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:57.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:57.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:57.819 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:57.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:58.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:58.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:58.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:58.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:59.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:30:59.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:30:59.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:30:59.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:00.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:00.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:00.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:00.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:01.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:01.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:01.780 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:01.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:02.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:02.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:02.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:02.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:03.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:03.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:03.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:03.770+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:04.466 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:04.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:04.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:04.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:05.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:05.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:05.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:05.815+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:06.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:06.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:06.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:06.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:07.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:07.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:07.798 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:07.799+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:08.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:08.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:08.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:08.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:09.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:09.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:09.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:09.844+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:10.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:10.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:10.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:10.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:11.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:11.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:11.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:11.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 141 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:12.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:12.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:12.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:12.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:13.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:13.459+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:13.839 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:13.840+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:14.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:14.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:14.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:14.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:15.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:15.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:15.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:15.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:16.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:16.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:16.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:16.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:17.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:17.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:17.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:17.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:18.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:18.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:18.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:18.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:19.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:19.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:19.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:19.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:20.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:20.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:20.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:20.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:21.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:21.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:21.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:21.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:22.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:22.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:22.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:22.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:23.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:23.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:23.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:23.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:24.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:24.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:24.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:24.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:25.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:25.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:25.771 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:25.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:26.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:26.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:26.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:26.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:27.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:27.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:27.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:27.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:28.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:28.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:28.842 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:28.843+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:29.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:29.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:29.880 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:29.881+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:30.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:30.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:30.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:30.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:31.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:31.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:31.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:31.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:32.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:32.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:32.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:32.870+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:33.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:33.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:33.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:33.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:34.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:34.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:34.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:34.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:35.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:35.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:35.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:35.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:36.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:36.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:36.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:36.877+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:37.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:37.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:37.881 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:37.882+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:38.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:38.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:38.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:38.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:39.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:39.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:39.894 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:39.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:40.473 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:40.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:40.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:40.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:41.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:41.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:41.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:41.924+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 59 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:42.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:42.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:42.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:42.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:43.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:43.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:43.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:43.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:44.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:44.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:44.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:44.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:45.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:45.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:45.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:45.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:46.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:46.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:46.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:46.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:47.335 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:47.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:47.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:47.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:48.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:48.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:48.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:48.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:49.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:49.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:49.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:49.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:50.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:50.375+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:50.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:50.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:51.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:51.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:51.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:51.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:52.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:52.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:52.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:52.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:53.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:53.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:53.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:53.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:54.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:54.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:55.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:55.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:55.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:55.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:56.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:56.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:56.321 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:56.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:57.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:57.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:57.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:57.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:57.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:57.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:58.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:58.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:31:58.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:31:58.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:31:59.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:31:59.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:00.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:00.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:00.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:00.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:01.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:01.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:01.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:01.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:02.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:02.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:02.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:02.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:03.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:03.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:03.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:03.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:04.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:04.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:04.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:04.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:04.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:04.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:05.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:05.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:05.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:05.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:06.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:06.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:06.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:06.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:07.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:07.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:07.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:07.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:08.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:08.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:08.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:08.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 77 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:32:09.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:09.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:09.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:09.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:10.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:10.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:10.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:10.905+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:11.265 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:11.266+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:11.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:11.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:12.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:12.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:12.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:12.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:13.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:13.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:13.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:13.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:14.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:14.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:14.908 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:14.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:15.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:15.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:15.893 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:15.894+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:16.247 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:16.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:16.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:16.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:17.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:17.222+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:17.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:17.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:18.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:18.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:18.878 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:18.879+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:19.153 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:19.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:19.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:19.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:20.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:20.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:20.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:20.853+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:21.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:21.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:21.879 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:21.880+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:22.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:22.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:22.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:22.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:23.116 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:23.117+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:23.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:23.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:24.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:24.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:24.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:24.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:25.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:25.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:25.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:25.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:26.049 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:26.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:26.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:26.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:27.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:27.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:27.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:27.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:28.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:28.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:28.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:28.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:29.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:29.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:30.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:30.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:30.045 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:30.046+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:31.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:31.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:31.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:31.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:32.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:32.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:32.073 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:32.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:33.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:33.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:33.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:33.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:34.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:34.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:34.107 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:34.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:35.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:35.086+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:35.120 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:35.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:36.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:36.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:36.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:36.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:37.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:37.101+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:37.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:37.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:38.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:38.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:38.174 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:38.175+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:39.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:39.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:39.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:39.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:40.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:40.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:40.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:40.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:41.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:41.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:41.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:41.190+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:42.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:42.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:42.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:42.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:43.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:43.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:43.171 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:43.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:44.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:44.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:44.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:44.204+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:45.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:45.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:45.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:45.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:46.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:46.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:46.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:46.195+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:46.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:46.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:47.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:47.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:47.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:47.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:48.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:48.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:48.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:48.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:49.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:49.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:50.020 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:50.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:50.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:50.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:51.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:51.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:51.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:51.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:52.062 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:52.063+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:52.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:52.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:53.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:53.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:53.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:53.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:54.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:54.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:54.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:54.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:55.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:55.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:55.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:55.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:55.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:55.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:56.285 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:56.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:56.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:56.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:57.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:57.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:57.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:57.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:58.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:58.258+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:58.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:58.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:59.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:32:59.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:32:59.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:32:59.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:00.253 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:00.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:01.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:01.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:01.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:01.299+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:02.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:02.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:02.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:02.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:03.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:03.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:03.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:03.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:04.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:04.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:04.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:04.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:05.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:05.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:05.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:05.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:05.989 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:05.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:06.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:06.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:06.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:06.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:07.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:07.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:07.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:07.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:08.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:08.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:09.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:09.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:09.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:09.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:09.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:09.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:10.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:10.371+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:10.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:10.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:11.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:11.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:11.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:11.937+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:12.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:12.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:12.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:12.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:13.432 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:13.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:13.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:13.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:14.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:14.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:14.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:14.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:15.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:15.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:15.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:15.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:16.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:16.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:16.904 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:16.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:17.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:17.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:17.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:17.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:18.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:18.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:18.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:18.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:19.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:19.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:19.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:19.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:20.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:20.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:20.901 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:20.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:21.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:21.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:21.906 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:21.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:22.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:22.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:22.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:22.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:23.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:23.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:23.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:23.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:24.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:24.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:24.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:24.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:25.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:25.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:26.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:26.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:26.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:26.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:27.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:27.021+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:27.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:27.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:28.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:28.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:28.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:28.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:29.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:29.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:29.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:29.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:29.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:29.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:30.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:30.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:30.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:30.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:31.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:31.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:31.943 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:31.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:32.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:32.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:32.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:32.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:33.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:33.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:33.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:33.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:34.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:34.328+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:34.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:34.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:35.377 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:35.378+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:35.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:35.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:36.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:36.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:36.951 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:36.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:37.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:37.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:37.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:37.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:38.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:38.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:38.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:38.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:39.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:39.369+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:39.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:39.951+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:40.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:40.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:40.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:40.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:41.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:41.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:41.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:41.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:42.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:42.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:42.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:42.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:43.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:43.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:43.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:43.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:44.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:44.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:44.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:44.954+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:45.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:45.412+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:45.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:45.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:46.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:46.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:46.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:46.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:47.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:47.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:47.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:47.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:48.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:48.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:48.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:48.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:49.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:49.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:49.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:49.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:50.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:50.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:50.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:50.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:51.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:51.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:51.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:51.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:52.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:52.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:52.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:52.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:53.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:53.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:53.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:53.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:54.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:54.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:54.897 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:54.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:55.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:55.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:55.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:55.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:56.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:56.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:56.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:56.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:57.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:57.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:57.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:57.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:58.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:58.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:58.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:58.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:59.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:33:59.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:33:59.883 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:33:59.883+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:00.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:00.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:00.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:00.899+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:01.261 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:01.262+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:01.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:01.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:02.243 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:02.243+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:02.912 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:02.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:03.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:03.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:03.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:03.931+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:04.167 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:04.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:04.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:04.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:05.160 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:05.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:05.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:05.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:06.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:06.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:06.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:06.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:07.191 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:07.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:07.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:07.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:08.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:08.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:08.970 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:08.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:09.212 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:09.213+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:09.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:09.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:10.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:10.167+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:10.916 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:10.918+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:11.123 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:11.125+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:11.898 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:11.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:12.129 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:12.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:12.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:12.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:13.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:13.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:13.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:13.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:14.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:14.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:14.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:14.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:15.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:15.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:16.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:16.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:16.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:16.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:16.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:16.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:17.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:17.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:17.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:17.960+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:18.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:18.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:18.974 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:18.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:18.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:18.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:19.947 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:19.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:20.040 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:20.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:20.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:20.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:21.046 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:21.045+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:22.039 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:22.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:22.091 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:22.092+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:23.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:23.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:23.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:23.087+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:24.042 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:24.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:24.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:24.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:25.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:25.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:25.113 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:25.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:26.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:26.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:26.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:26.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:27.067 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:27.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:27.101 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:27.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:28.031 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:28.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:28.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:28.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:29.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:29.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:29.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:29.146+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:30.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:30.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:30.155 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:30.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:31.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:31.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:31.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:31.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:32.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:32.019+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:32.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:32.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:33.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:33.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:33.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:33.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:34.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:34.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:34.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:34.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:35.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:35.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:35.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:35.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:36.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:36.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:36.175 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:36.176+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:37.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:37.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:37.162 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:37.163+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:38.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:38.089+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:38.202 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:38.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:39.045 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:39.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:39.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:39.161+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:40.080 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:40.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:40.188 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:40.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:41.064 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:41.065+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:41.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:41.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:42.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:42.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:42.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:42.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:43.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:43.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:43.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:43.235+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:44.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:44.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:44.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:44.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:45.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:45.135+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:45.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:45.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:46.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:46.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:46.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:46.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:47.143 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:47.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:47.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:47.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:48.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:48.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:48.311 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:48.312+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:49.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:49.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:49.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:49.335+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:50.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:50.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:50.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:50.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:51.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:51.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:51.302 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:51.303+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:52.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:52.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:52.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:52.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:53.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:53.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:53.308 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:53.308+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:54.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:54.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:54.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:54.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:55.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:55.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:55.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:55.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:56.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:56.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:56.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:56.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:57.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:57.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:57.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:57.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:58.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:58.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:58.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:58.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:59.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:34:59.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:34:59.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:34:59.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:00.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:00.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:00.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:00.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:01.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:01.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:01.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:01.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:02.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:02.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:02.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:02.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:03.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:03.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:03.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:03.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:04.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:04.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:04.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:04.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:05.133 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:05.134+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:05.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:05.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:06.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:06.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:06.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:06.505+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:07.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:07.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:07.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:07.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:08.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:08.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:08.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:08.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:09.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:09.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:09.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:09.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:10.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:10.107+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:10.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:10.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:11.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:11.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:11.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:11.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:12.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:12.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:12.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:12.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:13.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:13.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:13.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:13.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:14.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:14.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:14.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:14.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:15.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:15.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:15.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:15.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:16.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:16.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:16.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:16.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:17.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:17.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:17.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:17.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:18.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:18.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:18.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:18.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:19.058 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:19.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:19.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:19.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:20.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:20.067+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:20.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:20.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:21.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:21.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:21.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:21.418+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:22.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:22.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:22.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:22.432+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:23.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:23.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:23.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:23.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:24.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:24.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:24.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:24.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:25.093 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:25.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:25.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:25.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:26.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:26.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:26.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:26.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:27.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:27.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:27.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:27.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:28.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:28.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:28.396 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:28.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:29.134 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:29.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:29.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:29.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:30.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:30.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:30.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:30.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:31.140 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:31.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:31.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:31.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:32.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:32.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:32.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:32.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:33.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:33.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:33.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:33.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:34.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:34.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:34.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:34.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:35.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:35.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:35.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:35.483+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:36.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:36.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:36.454 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:36.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:37.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:37.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:37.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:37.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:38.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:38.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:38.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:38.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:39.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:39.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:39.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:39.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:40.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:40.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:40.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:40.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:41.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:41.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:41.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:41.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:42.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:42.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:42.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:42.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:43.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:43.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:43.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:43.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:44.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:44.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:44.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:44.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:45.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:45.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:45.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:45.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:46.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:46.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:46.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:46.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:47.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:47.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:47.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:47.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:48.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:48.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:48.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:48.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:49.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:49.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:49.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:49.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:50.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:50.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:50.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:50.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:51.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:51.058+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:51.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:51.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:52.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:52.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:52.554 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:52.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:53.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:53.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:53.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:53.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:54.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:54.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:54.551 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:54.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:54.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:54.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:55.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:55.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:55.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:55.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:56.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:56.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:56.932 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:56.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:57.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:57.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:57.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:57.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:58.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:58.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:58.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:58.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:59.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:35:59.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:35:59.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:35:59.975+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:00.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:00.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:00.935 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:00.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:01.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:01.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:01.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:01.896+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:02.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:02.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:02.917 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:02.917+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:03.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:03.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:03.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:03.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:04.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:04.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:04.903 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:04.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:05.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:05.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:05.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:05.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:06.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:06.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:06.936 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:06.936+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:07.474 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:07.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:07.938 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:07.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:08.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:08.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:08.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:08.914+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:09.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:09.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:09.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:09.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:10.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:10.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:10.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:10.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:11.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:11.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:11.941 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:11.942+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:12.510 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:12.511+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:12.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:12.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:13.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:13.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:13.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:13.949+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:14.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:14.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:14.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:14.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:15.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:15.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:15.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:15.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:16.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:16.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:16.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:16.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:17.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:17.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:17.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:17.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:18.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:18.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:19.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:19.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:19.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:19.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:19.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:19.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:20.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:20.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:20.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:20.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:21.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:21.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:21.977 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:21.978+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:22.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:22.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:22.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:22.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:23.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:23.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:24.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:24.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:24.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:24.772+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:25.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:25.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:25.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:25.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:26.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:26.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:26.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:26.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:27.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:27.040+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:27.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:27.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:28.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:28.057+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:28.753 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:28.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:29.015 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:29.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:29.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:29.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:29.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:29.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:30.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:30.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:30.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:30.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:31.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:31.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:31.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:31.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:32.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:32.757+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:32.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:32.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:33.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:33.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:33.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:33.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:34.731 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:34.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:34.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:34.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:35.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:35.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:35.973 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:35.974+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:36.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:36.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:36.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:36.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:37.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:37.761+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:37.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:37.919+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:38.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:38.801+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:38.911 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:38.912+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:39.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:39.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:39.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:39.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:40.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:40.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:40.886 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:40.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:41.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:41.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:41.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:41.925+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:42.862 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:42.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:42.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:42.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:43.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:43.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:43.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:43.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:44.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:44.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:44.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:44.927+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:45.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:45.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:45.888 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:45.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:46.782 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:46.783+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:46.889 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:46.891+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:47.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:47.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:47.891 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:47.893+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:48.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:48.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:48.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:48.845+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:49.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:49.821+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:49.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:49.826+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:50.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:50.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:50.833 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:50.835+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:51.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:51.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:51.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:51.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:52.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:52.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:52.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:52.836+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:53.747 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:53.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:53.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:53.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:54.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:54.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:54.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:54.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:55.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:55.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:55.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:55.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:56.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:56.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:56.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:56.785+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:57.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:57.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:57.768 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:57.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:58.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:58.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:58.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:58.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:59.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:36:59.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:36:59.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:36:59.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:00.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:00.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:00.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:00.782+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:01.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:01.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:01.812 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:01.813+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:02.734 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:02.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:02.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:02.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:03.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:03.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:03.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:03.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:04.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:04.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:04.806 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:04.806+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:05.606 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:05.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:05.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:05.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:06.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:06.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:06.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:06.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:07.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:07.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:07.833 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:07.834+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:08.520 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:08.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:08.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:08.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:09.524 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:09.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:09.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:09.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:10.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:10.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:10.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:10.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:11.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:11.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:11.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:11.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:12.530 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:12.531+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:12.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:12.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:13.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:13.482+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:13.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:13.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:14.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:14.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:14.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:14.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:15.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:15.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:15.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:15.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:16.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:16.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:16.963 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:16.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:17.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:17.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:17.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:17.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:18.417 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:18.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:18.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:18.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:19.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:19.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:19.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:19.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:20.440 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:20.441+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:20.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:20.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:21.458 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:21.459+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:21.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:21.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:22.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:22.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:23.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:23.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:23.480 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:23.480+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:24.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:24.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:24.443 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:24.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:25.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:25.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:25.467 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:25.468+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:26.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:26.043+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:26.438 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:26.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:27.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:27.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:27.404 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:27.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:28.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:28.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:28.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:28.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:29.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:29.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:29.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:29.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:30.086 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:30.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:30.377 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:30.378+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:31.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:31.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:31.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:31.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:32.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:32.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:32.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:32.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:33.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:33.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:33.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:33.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:34.142 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:34.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:34.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:34.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:35.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:35.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:35.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:35.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:36.190 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:36.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:36.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:36.380+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:37.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:37.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:37.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:37.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:38.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:38.140+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:38.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:38.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:39.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:39.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:39.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:39.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:40.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:40.106+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:40.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:40.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:41.133 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:41.134+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:41.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:41.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:42.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:42.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:42.339 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:42.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:43.169 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:43.169+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:43.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:43.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:44.165 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:44.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:44.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:44.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:45.179 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:45.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:45.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:45.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:46.132 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:46.132+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:46.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:46.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:47.161 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:47.162+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:47.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:47.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:48.205 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:48.206+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:48.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:48.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:49.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:49.214+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:49.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:49.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:50.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:50.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:50.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:50.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:51.189 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:51.191+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:51.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:51.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:52.199 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:52.201+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:52.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:52.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:53.200 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:53.202+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:53.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:53.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:54.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:54.199+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:54.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:54.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:55.216 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:55.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:55.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:55.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:56.185 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:56.187+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:56.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:56.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:57.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:57.151+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:57.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:57.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:58.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:58.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:58.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:58.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:59.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:37:59.218+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:37:59.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:37:59.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:00.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:00.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:00.255 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:00.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:01.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:01.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:01.225 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:01.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:02.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:02.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:02.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:02.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:03.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:03.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:03.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:03.226+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:04.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:04.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:04.223 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:04.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:05.203 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:05.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:05.218 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:05.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:06.206 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:06.207+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:06.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:06.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:07.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:07.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:07.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:07.256+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:08.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:08.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:08.297 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:08.298+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:09.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:09.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:09.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:09.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:10.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:10.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:10.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:10.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:11.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:11.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:11.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:11.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:12.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:12.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:12.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:12.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:13.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:13.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:13.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:13.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:14.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:14.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:14.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:14.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:15.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:15.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:15.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:15.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:16.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:16.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:16.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:16.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:17.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:17.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:17.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:17.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:18.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:18.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:18.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:18.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:19.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:19.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:19.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:19.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:20.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:20.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:20.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:20.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:21.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:21.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:21.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:21.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:22.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:22.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:22.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:22.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:23.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:23.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:23.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:23.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:24.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:24.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:24.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:24.339+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:25.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:25.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:25.356 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:25.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:26.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:26.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:26.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:26.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:27.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:27.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:27.344 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:27.345+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:28.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:28.202+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:28.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:28.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:29.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:29.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:29.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:29.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:30.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:30.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:30.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:30.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:31.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:31.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:31.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:31.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:32.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:32.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:32.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:32.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:33.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:33.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:33.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:33.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:34.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:34.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:34.452 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:34.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:35.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:35.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:35.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:35.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:36.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:36.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:36.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:36.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:37.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:37.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:37.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:37.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:38.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:38.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:38.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:38.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:39.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:39.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:39.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:39.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:40.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:40.171+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:40.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:40.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:41.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:41.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:41.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:41.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:42.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:42.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:42.594 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:42.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:43.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:43.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:43.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:43.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:44.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:44.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:44.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:44.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:45.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:45.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:45.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:45.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:46.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:46.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:46.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:46.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:47.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:47.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:47.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:47.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:48.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:48.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:48.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:48.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:49.162 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:49.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:49.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:49.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:50.149 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:50.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:50.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:50.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:51.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:51.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:51.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:51.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:52.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:52.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:52.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:52.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:53.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:53.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:53.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:53.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:54.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:54.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:54.734 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:54.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:55.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:55.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:55.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:55.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:56.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:56.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:56.769 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:56.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:57.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:57.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:57.816 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:57.817+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:58.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:58.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:58.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:58.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:59.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:38:59.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:38:59.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:38:59.866+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:00.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:00.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:00.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:00.860+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:01.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:01.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:01.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:01.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:02.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:02.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:02.851 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:02.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:03.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:03.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:03.820 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:03.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:04.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:04.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:04.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:04.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:05.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:05.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:05.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:05.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:06.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:06.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:06.814 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:06.816+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:07.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:07.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:07.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:07.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:08.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:08.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:08.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:08.815+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:09.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:09.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:09.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:09.845+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:10.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:10.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:10.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:10.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:11.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:11.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:11.934 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:11.936+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:12.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:12.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:12.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:12.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:13.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:13.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:13.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:13.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:14.146 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:14.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:14.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:14.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:15.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:15.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:15.842 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:15.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:16.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:16.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:16.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:16.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:17.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:17.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:17.875 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:17.876+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:18.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:18.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:18.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:18.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:19.118 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:19.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:19.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:19.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:20.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:20.092+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:20.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:20.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:21.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:21.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:21.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:21.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:22.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:22.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:22.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:22.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:23.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:23.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:23.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:23.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:24.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:24.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:24.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:24.893+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:25.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:25.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:25.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:25.928+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:26.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:26.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:26.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:26.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:27.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:27.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:28.019 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:28.020+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:28.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:28.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:29.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:29.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:29.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:29.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:30.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:30.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:30.054 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:30.054+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:30.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:30.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:31.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:31.049+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:31.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:31.938+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:32.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:32.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:32.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:32.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:33.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:33.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:33.896 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:33.897+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:34.099 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:34.100+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:34.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:34.856+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:35.131 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:35.131+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:35.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:35.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:36.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:36.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:36.862 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:36.863+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:37.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:37.119+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:37.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:37.850+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:38.084 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:38.085+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:38.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:38.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:39.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:39.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:39.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:39.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:40.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:40.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:40.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:40.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:41.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:41.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:41.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:41.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:42.138 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:42.139+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:42.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:42.747+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:43.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:43.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:43.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:43.707+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:44.136 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:44.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:44.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:44.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:45.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:45.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:45.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:45.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:46.168 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:46.168+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:46.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:46.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:47.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:47.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:47.640 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:47.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:48.183 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:48.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:48.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:48.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:49.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:49.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:49.706 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:49.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:50.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:50.158+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:50.751 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:50.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:51.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:51.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:51.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:51.743+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:52.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:52.136+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:52.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:52.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:53.149 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:53.150+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:53.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:53.751+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:54.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:54.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:54.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:54.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:55.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:55.083+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:55.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:55.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:56.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:56.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:56.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:56.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:57.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:57.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:57.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:57.745+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:58.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:58.183+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:58.729 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:58.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:59.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:39:59.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:39:59.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:39:59.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:00.238 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:00.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:00.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:00.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:01.222 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:01.223+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:01.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:01.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:02.233 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:02.234+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:02.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:02.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:03.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:03.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:03.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:03.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:04.244 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:04.245+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:04.737 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:04.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:05.224 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:05.225+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:05.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:05.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:06.204 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:06.205+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:06.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:06.738+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:07.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:07.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:07.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:07.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:08.296 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:08.297+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:08.726 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:08.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:09.254 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:09.255+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:09.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:09.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:10.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:10.228+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:10.792 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:10.793+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:11.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:11.193+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:11.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:11.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:12.197 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:12.198+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:12.811 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:12.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:13.239 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:13.240+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:13.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:13.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:14.250 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:14.251+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:14.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:14.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:15.283 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:15.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:15.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:15.725+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:16.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:16.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:16.724 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:16.726+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:17.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:17.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:17.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:17.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:18.248 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:18.249+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:18.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:18.805+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:19.231 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:19.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:19.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:19.795+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:20.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:20.232+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:20.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:20.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:21.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:21.276+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:21.768 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:21.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:22.307 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:22.309+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:22.800 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:22.802+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:23.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:23.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:23.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:23.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:24.284 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:24.286+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:24.865 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:24.867+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:25.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:25.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:25.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:25.886+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:26.245 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:26.247+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:26.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:26.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:27.236 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:27.238+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:27.799 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:27.801+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:28.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:28.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:28.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:28.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:29.275 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:29.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:29.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:29.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:30.298 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:30.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:30.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:30.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:31.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:31.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:31.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:31.812+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:32.249 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:32.250+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:32.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:32.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:33.289 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:33.291+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:33.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:33.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:34.317 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:34.318+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:34.795 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:34.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:35.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:35.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:35.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:35.777+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:36.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:36.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:36.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:36.735+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:37.338 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:37.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:37.766 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:37.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:38.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:38.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:38.767 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:38.768+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:39.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:39.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:39.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:39.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:40.341 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:40.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:40.739 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:40.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:41.292 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:41.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:41.745 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:41.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:42.303 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:42.304+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:42.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:42.762+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:43.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:43.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:43.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:43.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:44.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:44.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:44.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:44.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:45.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:45.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:45.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:45.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:46.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:46.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:46.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:46.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:47.324 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:47.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:47.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:47.728+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:48.301 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:48.301+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:48.762 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:48.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:49.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:49.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:49.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:49.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:50.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:50.323+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:50.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:50.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:51.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:51.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:51.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:51.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:52.358 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:52.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:52.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:52.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:53.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:53.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:53.809 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:53.810+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:54.428 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:54.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:54.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:54.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:55.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:55.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:55.778 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:55.779+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:56.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:56.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:56.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:56.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:57.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:57.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:57.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:57.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:58.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:58.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:58.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:58.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:59.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:40:59.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:40:59.840 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:40:59.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:00.350 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:00.351+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:00.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:00.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:01.342 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:01.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:01.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:01.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:02.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:02.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:02.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:02.838+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:03.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:03.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:03.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:03.803+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:04.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:04.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:04.774 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:04.775+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:05.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:05.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:05.808 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:05.809+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:06.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:06.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:06.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:06.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:07.337 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:07.338+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:07.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:07.817+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:08.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:08.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:08.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:08.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:09.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:09.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:09.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:09.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:10.320 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:10.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:10.728 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:10.729+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:11.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:11.350+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:11.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:11.721+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:12.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:12.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:12.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:12.714+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:13.345 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:13.346+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:13.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:13.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:14.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:14.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:14.716 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:14.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:15.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:15.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:15.713 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:15.713+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:16.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:16.314+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:16.666 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:16.667+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:17.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:17.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:17.664 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:17.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:18.355 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:18.355+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:18.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:18.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:19.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:19.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:19.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:19.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:20.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:20.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:20.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:20.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:21.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:21.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:21.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:21.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:22.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:22.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:22.649 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:22.650+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:23.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:23.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:23.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:23.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:24.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:24.405+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:24.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:24.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:25.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:25.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:25.668 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:25.669+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:26.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:26.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:26.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:26.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:27.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:27.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:27.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:27.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:28.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:28.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:28.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:28.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:29.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:29.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:29.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:29.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:30.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:30.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:30.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:30.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:31.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:31.428+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:31.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:31.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:32.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:32.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:32.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:32.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:33.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:33.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:33.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:33.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:34.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:34.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:34.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:34.594+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:35.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:35.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:35.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:35.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:36.511 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:36.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:36.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:36.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:37.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:37.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:37.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:37.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:38.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:38.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:38.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:38.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:39.531 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:39.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:39.550 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:39.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:40.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:40.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:40.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:40.597+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:41.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:41.525+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:41.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:41.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:42.533 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:42.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:42.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:42.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:43.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:43.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:43.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:43.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:44.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:44.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:44.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:44.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:45.545 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:45.547+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:45.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:45.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:46.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:46.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:46.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:46.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:47.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:47.539+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:47.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:47.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:48.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:48.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:48.710 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:48.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:49.486 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:49.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:49.702 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:49.704+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:50.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:50.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:50.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:50.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:51.485 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:51.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:51.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:51.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:52.529 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:52.530+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:52.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:52.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:53.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:53.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:53.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:53.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:54.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:54.579+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:54.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:54.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:55.559 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:55.561+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:55.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:55.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:56.583 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:56.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:56.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:56.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:57.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:57.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:57.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:57.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:58.501 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:58.502+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:58.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:58.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:59.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:41:59.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:41:59.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:41:59.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:00.463 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:00.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:00.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:00.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:01.453 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:01.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:01.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:01.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:02.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:02.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:02.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:02.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:03.499 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:03.500+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:03.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:03.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:04.497 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:04.498+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:04.519 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:04.520+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:05.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:05.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:05.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:05.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:06.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:06.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:06.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:06.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:07.483 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:07.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:07.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:07.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:08.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:08.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:08.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:08.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:09.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:09.455+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:09.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:09.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:10.468 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:10.469+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:10.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:10.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:11.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:11.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:11.489 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:11.491+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:12.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:12.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:12.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:12.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:13.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:13.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:13.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:13.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:14.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:14.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:14.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:14.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:15.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:15.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:15.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:15.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:16.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:16.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:16.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:16.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:17.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:17.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:17.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:17.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:18.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:18.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:18.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:18.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:19.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:19.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:19.591 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:19.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:20.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:20.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:20.588 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:20.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:21.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:21.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:21.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:21.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:22.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:22.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:22.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:22.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:23.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:23.478+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:23.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:23.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:24.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:24.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:24.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:24.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:25.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:25.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:25.658 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:25.659+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:26.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:26.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:26.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:26.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:27.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:27.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:27.691 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:27.692+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:28.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:28.550+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:28.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:28.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:29.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:29.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:29.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:29.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:30.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:30.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:30.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:30.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:31.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:31.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:31.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:31.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:32.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:32.520+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:32.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:32.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:33.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:33.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:33.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:33.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:34.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:34.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:34.627 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:34.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:35.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:35.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:35.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:35.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:36.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:36.594+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:36.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:36.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:37.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:37.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:37.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:37.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:38.636 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:38.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:38.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:38.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:39.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:39.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:39.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:39.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:40.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:40.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:40.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:40.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:41.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:41.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:41.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:41.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:42.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:42.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:42.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:42.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:43.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:43.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:43.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:43.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:44.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:44.587+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:44.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:44.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:45.553 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:45.554+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:45.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:45.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:46.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:46.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:46.721 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:46.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:47.542 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:47.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:47.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:47.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:48.570 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:48.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:48.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:48.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:49.525 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:49.527+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:49.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:49.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:50.491 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:50.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:50.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:50.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:51.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:51.513+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:51.661 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:51.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:52.465 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:52.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:52.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:52.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:53.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:53.464+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:53.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:53.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:54.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:54.444+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:54.588 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:54.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:55.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:55.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:55.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:55.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:56.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:56.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:56.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:56.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:57.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:57.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:57.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:57.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:58.437 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:58.439+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:58.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:58.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:59.396 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:42:59.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:42:59.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:42:59.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:00.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:00.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:00.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:00.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:01.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:01.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:01.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:01.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:02.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:02.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:02.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:02.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:03.449 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:03.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:03.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:03.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:04.474 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:04.476+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:04.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:04.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:05.479 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:05.481+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:05.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:05.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:06.482 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:06.484+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:06.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:06.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:07.506 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:07.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:07.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:07.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:08.492 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:08.494+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:08.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:08.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:09.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:09.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:09.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:09.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:10.446 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:10.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:10.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:10.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:11.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:11.478+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:11.627 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:11.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:12.431 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:12.432+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:12.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:12.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:13.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:13.388+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:13.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:13.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:14.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:14.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:14.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:14.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:15.409 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:15.410+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:15.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:15.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:16.460 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:16.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:16.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:16.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:17.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:17.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:17.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:17.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:18.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:18.437+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:18.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:18.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:19.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:19.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:19.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:19.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:20.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:20.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:20.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:20.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:21.349 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:21.350+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:21.716 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:21.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:22.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:22.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:22.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:22.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:23.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:23.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:23.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:23.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:24.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:24.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:24.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:24.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:25.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:25.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:25.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:25.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:26.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:26.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:26.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:26.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:27.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:27.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:27.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:27.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:28.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:28.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:28.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:28.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:29.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:29.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:29.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:29.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:30.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:30.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:30.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:30.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:31.308 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:31.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:31.619 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:31.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:32.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:32.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:32.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:32.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:33.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:33.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:33.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:33.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:34.378 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:34.379+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:34.694 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:34.695+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:35.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:35.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:35.722 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:35.723+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:36.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:36.443+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:36.750 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:36.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:37.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:37.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:37.740 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:37.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:38.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:38.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:38.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:38.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:39.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:39.426+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:39.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:39.712+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:40.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:40.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:40.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:40.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:41.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:41.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:41.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:41.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:42.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:42.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:42.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:42.721+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:43.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:43.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:43.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:43.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:44.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:44.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:44.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:44.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:45.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:45.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:45.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:45.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:46.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:46.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:46.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:46.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:47.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:47.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:47.655 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:47.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:48.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:48.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:48.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:48.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:49.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:49.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:49.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:49.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:50.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:50.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:50.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:50.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:51.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:51.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:51.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:51.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:52.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:52.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:52.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:52.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:53.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:53.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:53.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:53.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:54.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:54.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:54.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:54.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:55.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:55.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:55.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:55.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:56.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:56.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:56.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:56.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:57.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:57.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:57.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:57.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:58.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:58.195+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:58.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:58.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:59.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:43:59.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:43:59.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:43:59.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:00.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:00.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:00.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:00.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:01.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:01.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:01.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:01.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:02.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:02.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:02.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:02.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:03.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:03.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:03.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:03.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:04.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:04.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:04.698 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:04.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:05.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:05.081+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:05.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:05.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:06.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:06.119+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:06.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:06.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:07.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:07.130+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:07.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:07.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:08.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:08.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:08.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:08.660+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:09.142 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:09.144+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:09.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:09.685+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:10.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:10.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:10.671 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:10.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:11.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:11.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:11.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:11.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:12.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:12.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:12.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:12.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:13.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:13.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:13.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:13.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:14.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:14.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:14.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:14.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:15.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:15.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:15.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:15.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:16.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:16.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:16.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:16.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:17.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:17.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:17.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:17.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:18.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:18.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:18.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:18.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:19.138 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:19.140+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:19.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:19.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:20.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:20.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:20.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:20.692+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:21.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:21.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:21.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:21.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:22.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:22.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:22.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:22.781+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:23.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:23.141+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:23.805 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:23.808+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:24.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:24.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:24.802 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:24.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:25.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:25.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:25.844 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:25.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:26.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:26.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:26.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:26.802+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:27.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:27.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:27.813 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:27.814+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:28.110 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:28.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:28.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:28.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:29.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:29.147+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:29.829 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:29.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:30.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:30.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:30.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:30.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:31.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:31.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:31.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:31.830+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:32.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:32.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:32.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:32.838+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:33.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:33.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:33.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:33.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:34.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:34.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:34.822 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:34.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:35.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:35.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:35.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:35.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:36.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:36.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:36.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:36.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:37.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:37.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:37.773 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:37.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:38.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:38.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:38.725 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:38.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:39.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:39.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:39.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:39.716+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:40.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:40.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:40.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:40.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:41.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:41.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:41.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:41.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:42.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:42.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:42.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:42.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:43.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:43.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:43.744 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:43.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:44.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:44.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:44.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:44.775+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:45.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:45.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:45.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:45.733+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:46.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:46.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:46.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:46.743+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:47.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:47.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:47.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:47.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:48.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:48.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:48.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:48.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:49.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:49.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:49.673 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:49.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:50.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:50.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:50.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:50.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:51.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:51.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:51.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:51.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:52.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:52.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:52.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:52.709+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:53.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:53.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:53.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:53.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:54.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:54.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:54.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:54.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:55.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:55.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:55.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:55.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:56.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:56.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:56.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:56.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:57.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:57.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:57.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:57.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:58.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:58.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:58.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:58.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:59.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:44:59.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:44:59.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:44:59.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:00.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:00.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:00.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:00.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:01.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:01.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:01.656 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:01.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:02.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:02.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:02.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:02.696+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:03.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:03.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:03.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:03.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:04.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:04.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:04.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:04.668+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:05.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:05.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:05.685 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:05.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:06.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:06.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:06.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:06.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:07.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:07.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:07.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:07.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:08.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:08.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:08.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:08.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:09.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:09.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:09.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:09.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:10.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:10.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:10.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:10.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:11.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:11.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:11.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:11.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:12.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:12.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:12.628 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:12.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:13.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:13.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:13.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:13.662+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:14.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:14.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:14.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:14.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:15.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:15.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:15.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:15.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:16.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:16.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:16.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:16.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:17.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:17.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:17.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:17.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:18.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:18.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:18.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:18.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:19.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:19.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:19.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:19.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:20.201 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:20.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:20.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:20.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:21.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:21.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:21.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:21.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:22.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:22.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:22.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:22.474+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:23.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:23.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:23.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:23.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:24.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:24.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:24.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:24.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:25.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:25.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:25.459 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:25.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:26.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:26.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:26.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:26.414+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:27.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:27.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:27.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:27.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:28.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:28.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:28.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:28.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:29.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:29.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:29.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:29.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:30.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:30.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:30.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:30.427+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:31.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:31.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:31.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:31.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:32.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:32.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:32.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:32.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:33.329 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:33.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:33.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:33.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:34.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:34.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:34.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:34.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:35.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:35.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:35.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:35.460+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:36.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:36.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:36.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:36.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:37.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:37.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:37.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:37.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:38.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:38.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:38.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:38.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:39.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:39.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:39.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:39.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:40.319 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:40.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:40.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:40.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:41.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:41.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:41.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:41.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:42.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:42.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:42.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:42.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:43.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:43.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:43.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:43.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:44.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:44.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:44.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:44.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:45.353 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:45.354+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:45.395 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:45.396+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:46.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:46.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:46.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:46.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:47.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:47.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:47.417 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:47.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:48.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:48.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:48.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:48.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:49.371 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:49.373+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:49.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:49.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:50.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:50.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:50.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:50.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:51.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:51.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:51.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:51.423+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:52.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:52.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:52.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:52.410+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:53.346 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:53.347+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:53.381 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:53.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:54.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:54.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:54.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:54.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:55.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:55.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:55.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:55.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:56.277 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:56.278+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:56.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:56.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:57.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:57.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:57.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:57.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:58.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:58.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:58.412 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:58.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:59.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:45:59.338+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:45:59.427 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:45:59.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:00.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:00.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:00.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:00.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:01.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:01.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:01.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:01.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:02.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:02.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:02.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:02.399+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:03.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:03.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:03.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:03.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:04.375 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:04.377+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:04.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:04.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:05.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:05.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:05.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:05.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:06.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:06.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:06.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:06.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:07.407 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:07.408+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:07.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:07.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:08.373 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:08.374+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:08.406 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:08.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:09.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:09.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:09.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:09.381+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:10.336 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:10.337+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:10.367 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:10.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:11.339 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:11.340+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:11.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:11.377+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:12.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:12.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:12.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:12.359+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:13.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:13.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:13.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:13.360+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:14.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:14.320+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:14.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:14.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:15.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:15.362+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:15.361 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:15.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:16.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:16.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:16.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:16.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:17.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:17.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:17.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:17.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:18.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:18.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:18.423 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:18.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:19.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:19.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:19.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:19.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:20.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:20.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:20.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:20.499+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:21.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:21.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:21.486 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:21.487+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:22.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:22.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:22.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:22.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:23.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:23.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:23.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:23.486+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:24.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:24.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:24.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:24.535+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:25.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:25.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:25.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:25.527+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:26.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:26.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:26.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:26.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:27.342 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:27.343+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:27.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:27.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:28.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:28.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:28.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:28.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:29.352 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:29.353+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:29.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:29.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:30.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:30.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:30.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:30.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:31.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:31.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:31.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:31.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:32.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:32.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:32.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:32.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:33.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:33.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:33.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:33.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:34.317 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:34.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:34.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:34.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:35.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:35.324+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:35.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:35.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:36.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:36.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:36.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:36.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:37.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:37.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:37.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:37.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:38.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:38.218+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:38.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:38.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:39.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:39.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 147 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:39.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:39.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:40.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:40.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:40.542 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:40.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:41.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:41.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:41.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:41.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:42.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:42.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:42.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:42.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:43.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:43.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:43.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:43.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:44.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:44.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:44.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:44.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:45.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:45.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:45.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:45.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:46.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:46.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:46.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:46.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:47.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:47.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:47.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:47.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:48.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:48.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:48.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:48.495+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:49.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:49.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:49.498 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:49.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:50.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:50.163+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:50.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:50.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:51.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:51.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:51.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:51.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:52.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:52.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:52.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:52.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:53.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:53.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:53.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:53.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:54.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:54.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:54.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:54.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:55.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:55.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:55.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:55.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:56.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:56.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:56.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:56.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:57.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:57.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:57.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:57.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:58.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:58.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:58.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:58.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:46:59.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:46:59.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:46:59.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:46:59.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:00.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:00.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:00.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:00.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:01.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:01.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:01.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:01.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:02.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:02.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:02.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:02.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:03.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:03.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:03.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:03.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:04.195 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:04.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:04.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:04.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:05.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:05.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:05.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:05.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:06.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:06.187+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:06.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:06.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:07.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:07.192+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:07.570 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:07.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:08.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:08.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:08.560 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:08.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:09.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:09.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 12 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] RETRY=1 ondisk+retry+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e25) 2023-07-23T02:47:09.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:09.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:10.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:10.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:10.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:10.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:11.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:11.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:11.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:11.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:12.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:12.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:12.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:12.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:13.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:13.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:13.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:13.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:14.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:14.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:14.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:14.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:15.312 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:15.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:15.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:15.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:16.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:16.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:16.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:16.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:17.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:17.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:17.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:17.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:18.347 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:18.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:18.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:18.656+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:19.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:19.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:19.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:19.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:20.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:20.297+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:20.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:20.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:21.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:21.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:21.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:21.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:22.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:22.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:22.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:22.602+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:23.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:23.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:23.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:23.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:24.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:24.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:24.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:24.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:25.345 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:25.346+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:25.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:25.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:26.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:26.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:26.704 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:26.705+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:27.362 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:27.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:27.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:27.745+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:28.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:28.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:28.714 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:28.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:29.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:29.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:29.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:29.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:30.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:30.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:30.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:30.737+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:31.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:31.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:31.777 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:31.778+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:32.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:32.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:32.765 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:32.765+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:33.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:33.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:33.737 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:33.738+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:34.267 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:34.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:34.766 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:34.767+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:35.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:35.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:35.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:35.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:36.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:36.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:36.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:36.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:37.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:37.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:37.821 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:37.822+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:38.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:38.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:38.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:38.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:39.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:39.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:39.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:39.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:40.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:40.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:40.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:40.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:41.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:41.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:41.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:41.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:42.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:42.291+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:42.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:42.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:43.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:43.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:43.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:43.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:44.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:44.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:44.863 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:44.864+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:45.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:45.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:45.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:45.910+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:46.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:46.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:46.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:46.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:47.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:47.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:47.919 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:47.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:48.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:48.231+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:48.935 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:48.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:49.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:49.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:49.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:49.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:50.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:50.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:51.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:51.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:51.231 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:51.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:52.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:52.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:52.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:52.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:52.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:52.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:53.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:53.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:53.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:53.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:54.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:54.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:54.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:54.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:55.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:55.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:55.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:55.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:56.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:56.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:56.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:56.908+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:57.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:57.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:57.890 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:57.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:58.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:58.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:58.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:58.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:59.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:47:59.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:47:59.899 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:47:59.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:00.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:00.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:00.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:00.939+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:01.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:01.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:01.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:01.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:02.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:02.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:02.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:02.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:03.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:03.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:03.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:03.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:04.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:04.174+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:04.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:04.929+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:05.192 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:05.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:05.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:05.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:06.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:06.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:06.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:06.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:07.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:07.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:07.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:07.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:08.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:08.295+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:08.881 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:08.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:09.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:09.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:09.860 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:09.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:10.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:10.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:10.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:10.862+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:11.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:11.193+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:11.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:11.890+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:12.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:12.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:12.939 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:12.940+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:13.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:13.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:13.970 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:13.971+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:14.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:14.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:14.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:14.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:15.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:15.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:16.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:16.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:16.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:16.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:16.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:16.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:17.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:17.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:17.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:17.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:18.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:18.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:18.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:18.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:19.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:19.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:20.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:20.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:20.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:20.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:21.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:21.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:21.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:21.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:21.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:21.974+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:22.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:22.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:22.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:22.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:23.135 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:23.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:23.997 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:23.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:24.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:24.098+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:25.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:25.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:25.097 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:25.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:26.054 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:26.054+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:26.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:26.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:27.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:27.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:27.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:27.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:28.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:28.096+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:28.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:28.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:29.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:29.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:29.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:29.118+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:30.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:30.062+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:30.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:30.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:31.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:31.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:31.127 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:31.128+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:32.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:32.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:32.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:32.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:33.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:33.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:33.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:33.131+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:34.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:34.075+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:34.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:34.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:35.043 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:35.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:35.087 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:35.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:36.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:36.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:36.083 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:36.084+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:37.090 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:37.091+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:37.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:37.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:38.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:38.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:38.143 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:38.143+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:38.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:38.997+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:39.177 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:39.178+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:40.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:40.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:40.157 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:40.157+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:41.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:41.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:41.172 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:41.172+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:42.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:42.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:42.192 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:42.192+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:43.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:43.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:43.227 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:43.227+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:44.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:44.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:44.195 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:44.196+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:45.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:45.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:45.159 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:45.160+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:46.141 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:46.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:46.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:46.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:47.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:47.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:47.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:47.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:48.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:48.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:48.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:48.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:49.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:49.078+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:49.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:49.221+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:50.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:50.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:50.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:50.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:51.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:51.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:51.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:51.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:52.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:52.122+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:52.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:52.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:53.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:53.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:53.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:53.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:54.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:54.128+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:54.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:54.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:55.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:55.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:55.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:55.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:56.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:56.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:56.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:56.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:57.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:57.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:57.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:57.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:58.093 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:58.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:58.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:58.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:59.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:48:59.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:48:59.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:48:59.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:00.089 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:00.091+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:00.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:00.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:01.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:01.123+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:01.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:01.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:02.087 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:02.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:02.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:02.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:03.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:03.113+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:03.198 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:03.199+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:04.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:04.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:04.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:04.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:05.139 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:05.141+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:05.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:05.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:06.140 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:06.142+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:06.302 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:06.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:07.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:07.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:07.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:07.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:08.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:08.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:08.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:08.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:09.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:09.108+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:09.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:09.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:10.135 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:10.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:10.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:10.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:11.128 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:11.130+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:11.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:11.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:12.112 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:12.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:12.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:12.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:13.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:13.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:13.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:13.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:14.178 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:14.179+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:14.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:14.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:15.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:15.174+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:15.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:15.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:16.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:16.219+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:16.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:16.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:17.201 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:17.203+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:17.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:17.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:18.196 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:18.197+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:18.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:18.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:19.198 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:19.200+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:19.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:19.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:20.154 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:20.156+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:20.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:20.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:21.151 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:21.153+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:21.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:21.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:22.152 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:22.154+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:22.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:22.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:23.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:23.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:23.186 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:23.188+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:24.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:24.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:24.211 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:24.211+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:25.182 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:25.182+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:25.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:25.197+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:26.145 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:26.145+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:26.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:26.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:27.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:27.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:27.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:27.215+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:28.100 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:28.101+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:28.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:28.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:29.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:29.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:29.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:29.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:30.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:30.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:30.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:30.156+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:31.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:31.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:31.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:31.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:32.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:32.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:32.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:32.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:33.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:33.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:33.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:33.115+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:34.067 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:34.067+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:34.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:34.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:35.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:35.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:35.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:35.137+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:36.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:36.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:36.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:36.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:37.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:37.069+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:37.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:37.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:38.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:38.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:38.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:38.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:39.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:39.007+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:39.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:39.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:40.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:40.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:40.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:40.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:40.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:40.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:41.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:41.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:42.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:42.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:42.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:42.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:43.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:43.053+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:43.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:43.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:44.063 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:44.064+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:44.117 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:44.118+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:45.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:45.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:45.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:45.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:46.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:46.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:46.110 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:46.111+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:47.102 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:47.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:47.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:47.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:48.106 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:48.107+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:48.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:48.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:49.077 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:49.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:49.099 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:49.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:50.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:50.083+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:50.092 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:50.093+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:51.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:51.047+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:51.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:51.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:52.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:52.015+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:52.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:52.088+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:53.056 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:53.056+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:53.103 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:53.103+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:54.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:54.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:54.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:54.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:55.078 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:55.078+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:55.094 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:55.094+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:56.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:56.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:56.086 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:56.087+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:57.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:57.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:57.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:57.125+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:58.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:58.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:58.147 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:58.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:59.082 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:49:59.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:49:59.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:49:59.180+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:00.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:00.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:00.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:00.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:01.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:01.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:01.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:01.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:02.047 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:02.047+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:02.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:02.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:03.070 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:03.071+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:03.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:03.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:04.057 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:04.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:04.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:04.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:05.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:05.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:05.193 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:05.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:05.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:05.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:06.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:06.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:06.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:06.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:07.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:07.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:08.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:08.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:08.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:08.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:08.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:08.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:09.189 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:09.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:10.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:10.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:10.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:10.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:11.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:11.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:11.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:11.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:12.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:12.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:12.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:12.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:13.032 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:13.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:13.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:13.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:14.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:14.018+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:14.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:14.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:15.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:15.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:15.187 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:15.189+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:16.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:16.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:16.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:16.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:17.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:17.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:17.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:17.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:18.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:18.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:18.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:18.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:19.085 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:19.086+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:19.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:19.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:20.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:20.066+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:20.286 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:20.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:21.022 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:21.024+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:21.241 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:21.242+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:22.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:22.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:22.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:22.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:23.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:23.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:23.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:23.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:24.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:24.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:24.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:24.302+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:25.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:25.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:25.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:25.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:25.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:25.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:26.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:26.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:26.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:26.998+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:27.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:27.371+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:28.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:28.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:28.335 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:28.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:29.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:29.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:29.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:29.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:30.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:30.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:30.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:30.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:31.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:31.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:31.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:31.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:31.973 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:31.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:32.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:32.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:32.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:32.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:33.296 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:33.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:33.974 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:33.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:34.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:34.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:35.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:35.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:35.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:35.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:36.004 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:36.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:36.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:36.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:37.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:37.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:37.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:37.330+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:38.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:38.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:38.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:38.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:39.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:39.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:39.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:39.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:39.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:39.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:40.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:40.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:40.992 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:40.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:41.307 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:41.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:41.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:41.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:42.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:42.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:42.996 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:42.997+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:43.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:43.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:44.042 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:44.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:44.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:44.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:45.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:45.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:45.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:45.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:46.068 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:46.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:46.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:46.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:47.096 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:47.097+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:47.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:47.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:48.052 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:48.053+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:48.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:48.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:49.088 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:49.089+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:49.179 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:49.179+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:50.058 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:50.058+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:50.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:50.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:51.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:51.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:51.181 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:51.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:51.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:51.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:52.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:52.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:53.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:53.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:53.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:53.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:54.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:54.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:54.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:54.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:55.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:55.041+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:55.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:55.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:56.044 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:56.044+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:56.100 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:56.100+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:57.009 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:57.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:57.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:57.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:57.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:57.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:58.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:58.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:59.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:50:59.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:50:59.128 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:50:59.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:00.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:00.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:00.103 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:00.104+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:01.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:01.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:01.098 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:01.099+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:02.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:02.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:02.108 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:02.109+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:02.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:02.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:03.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:03.111+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:04.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:04.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:04.096 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:04.097+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:04.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:04.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:05.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:05.079+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:05.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:05.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:06.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:06.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:07.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:07.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:07.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:07.103+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:07.995 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:07.995+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:08.132 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:08.133+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:08.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:08.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:09.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:09.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:09.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:09.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:10.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:10.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:10.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:10.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:11.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:11.162+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:11.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:11.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:12.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:12.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:12.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:12.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:13.126 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:13.127+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:13.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:13.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:14.165 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:14.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:14.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:14.914+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:15.155 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:15.155+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:15.900 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:15.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:16.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:16.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:16.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:16.946+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:17.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:17.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:17.926 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:17.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:18.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:18.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:18.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:18.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:19.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:19.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:19.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:19.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:20.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:20.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:20.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:20.906+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:21.131 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:21.132+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:21.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:21.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:22.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:22.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:22.895 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:22.895+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:23.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:23.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:23.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:23.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:24.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:24.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:24.907 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:24.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:25.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:25.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:25.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:25.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:26.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:26.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:26.960 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:26.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:27.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:27.293+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:27.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:27.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:28.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:28.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:28.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:28.951+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:29.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:29.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:29.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:29.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:30.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:30.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:30.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:30.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:31.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:31.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:32.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:32.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:32.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:32.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:33.003 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:33.004+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:33.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:33.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:33.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:33.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:34.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:34.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:34.985 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:34.986+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:35.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:35.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:36.001 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:36.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:36.306 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:36.308+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:37.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:37.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:37.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:37.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:38.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:38.080+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:38.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:38.286+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:39.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:39.040+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:39.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:39.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:40.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:40.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:40.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:40.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:40.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:40.993+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:41.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:41.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:42.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:42.007+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:42.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:42.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:42.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:42.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:43.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:43.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:43.966 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:43.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:44.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:44.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:44.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:44.925+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:45.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:45.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:45.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:45.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:46.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:46.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:46.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:46.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:47.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:47.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:47.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:47.899+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:48.248 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:48.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:48.898 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:48.900+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:49.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:49.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:49.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:49.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:50.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:50.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:50.834 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:50.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:51.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:51.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:51.809 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:51.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:52.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:52.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:52.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:52.805+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:53.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:53.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:53.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:53.843+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:54.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:54.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:54.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:54.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:55.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:55.250+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:55.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:55.916+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:56.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:56.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:56.910 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:56.911+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:57.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:57.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:57.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:57.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:58.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:58.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:58.927 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:58.927+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:59.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:51:59.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:51:59.882 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:51:59.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:00.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:00.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:00.840 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:00.840+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:01.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:01.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:01.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:01.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:02.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:02.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:02.903 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:02.903+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:03.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:03.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:03.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:03.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:04.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:04.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:04.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:04.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:05.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:05.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:05.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:05.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:06.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:06.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:06.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:06.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:07.259 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:07.259+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:07.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:07.883+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:08.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:08.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:08.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:08.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:09.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:09.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:09.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:09.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:10.291 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:10.292+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:10.879 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:10.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:11.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:11.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:11.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:11.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:12.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:12.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:12.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:12.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:13.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:13.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:13.870 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:13.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:14.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:14.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:14.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:14.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:15.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:15.351+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:15.839 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:15.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:16.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:16.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:16.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:16.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:17.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:17.300+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:17.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:17.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:18.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:18.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:18.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:18.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:19.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:19.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:19.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:19.793+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:20.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:20.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:20.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:20.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:21.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:21.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:21.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:21.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:22.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:22.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:22.778 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:22.779+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:23.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:23.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:23.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:23.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:24.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:24.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:24.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:24.789+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:25.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:25.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:25.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:25.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:26.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:26.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:26.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:26.746+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:27.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:27.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:27.719 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:27.719+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:28.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:28.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:28.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:28.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:29.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:29.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:29.726 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:29.726+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:30.243 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:30.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:30.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:30.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:31.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:31.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:31.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:31.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:32.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:32.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:32.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:32.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:33.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:33.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:33.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:33.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:34.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:34.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:34.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:34.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:35.295 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:35.296+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:35.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:35.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:36.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:36.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:36.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:36.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:37.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:37.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:37.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:37.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:38.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:38.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:38.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:38.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:39.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:39.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:39.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:39.679+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:40.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:40.334+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:40.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:40.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:41.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:41.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:41.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:41.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:42.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:42.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:42.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:42.622+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:43.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:43.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:43.575 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:43.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:44.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:44.307+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:44.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:44.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:45.301 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:45.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:45.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:45.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:46.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:46.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:46.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:46.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:47.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:47.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:47.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:47.553+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:48.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:48.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:48.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:48.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:49.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:49.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:49.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:49.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:50.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:50.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:50.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:50.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:51.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:51.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:51.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:51.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:52.374 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:52.375+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:52.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:52.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:53.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:53.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:53.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:53.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:54.399 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:54.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:54.662 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:54.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:55.393 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:55.394+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:55.638 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:55.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:56.354 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:56.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:56.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:56.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:57.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:57.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:57.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:57.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:58.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:58.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:58.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:58.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:59.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:52:59.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:52:59.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:52:59.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:00.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:00.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:00.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:00.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:01.300 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:01.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:01.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:01.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:02.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:02.348+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:02.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:02.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:03.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:03.333+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:03.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:03.664+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:04.298 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:04.298+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:04.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:04.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:05.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:05.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:05.677 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:05.677+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:06.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:06.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:06.693 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:06.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:07.364 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:07.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:07.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:07.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:08.332 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:08.332+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:08.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:08.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:09.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:09.336+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:09.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:09.605+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:10.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:10.382+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:10.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:10.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:11.430 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:11.430+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:11.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:11.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:12.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:12.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:12.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:12.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:13.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:13.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:13.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:13.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:14.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:14.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:14.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:14.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:15.405 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:15.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:15.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:15.519+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:16.388 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:16.389+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:16.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:16.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:17.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:17.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:17.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:17.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:18.454 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:18.454+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:18.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:18.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:19.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:19.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:19.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:19.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:20.461 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:20.461+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:20.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:20.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:21.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:21.448+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:21.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:21.507+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:22.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:22.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:22.511 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:22.512+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:23.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:23.394+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:23.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:23.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:24.414 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:24.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:24.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:24.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:25.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:25.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:25.574 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:25.574+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:26.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:26.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:26.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:26.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:27.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:27.372+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:27.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:27.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:28.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:28.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:28.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:28.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:29.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:29.419+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:29.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:29.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:30.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:30.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:30.617 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:30.617+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:31.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:31.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:31.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:31.653+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:32.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:32.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:32.608 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:32.609+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:33.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:33.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:33.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:33.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:34.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:34.466+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:34.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:34.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:35.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:35.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:35.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:35.623+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:36.462 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:36.462+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:36.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:36.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:37.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:37.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:37.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:37.582+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:38.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:38.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:38.569 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:38.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:39.477 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:39.477+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:39.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:39.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:40.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:40.492+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:40.560 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:40.560+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:41.471 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:41.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:41.602 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:41.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:42.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:42.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:42.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:42.572+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:43.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:43.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:43.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:43.608+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:44.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:44.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:44.566 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:44.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:45.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:45.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:45.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:45.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:46.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:46.468+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:46.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:46.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:47.433 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:47.433+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:47.523 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:47.524+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:48.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:48.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:48.556 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:48.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:49.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:49.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:49.546 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:49.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:50.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:50.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:50.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:50.541+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:51.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:51.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:51.564 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:51.566+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:52.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:52.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:52.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:52.546+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:53.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:53.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:53.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:53.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:54.372 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:54.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:54.532 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:54.533+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:55.394 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:55.395+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:55.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:55.515+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:56.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:56.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:56.490 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:56.492+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:57.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:57.344+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:57.487 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:57.488+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:58.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:58.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:58.462 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:58.463+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:59.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:53:59.317+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:53:59.464 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:53:59.465+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:00.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:00.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:00.432 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:00.434+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:01.267 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:01.268+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:01.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:01.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:02.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:02.248+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:02.386 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:02.387+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:03.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:03.257+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:03.385 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:03.386+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:04.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:04.252+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:04.413 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:04.414+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:05.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:05.267+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:05.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:05.446+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:06.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:06.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:06.477 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:06.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:07.258 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:07.260+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:07.444 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:07.445+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:08.286 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:08.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:08.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:08.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:09.281 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:09.283+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:09.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:09.404+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:10.330 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:10.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:10.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:10.428+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:11.325 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:11.326+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:11.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:11.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:12.295 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:12.296+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:12.472 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:12.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:13.315 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:13.316+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:13.441 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:13.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:14.332 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:14.334+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:14.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:14.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:15.379 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:15.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:15.414 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:15.415+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:16.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:16.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:16.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:16.423+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:17.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:17.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:17.466 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:17.467+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:18.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:18.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:18.493 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:18.493+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:19.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:19.373+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:19.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:19.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:20.391 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:20.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:20.518 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:20.518+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:21.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:21.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:21.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:21.537+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:22.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:22.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:22.535 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:22.535+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:23.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:23.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:23.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:23.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:24.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:24.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:24.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:24.585+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:25.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:25.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:25.558 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:25.558+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:26.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:26.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:26.552 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:26.552+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:27.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:27.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:27.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:27.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:28.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:28.457+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:28.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:28.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:29.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:29.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:29.597 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:29.597+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:30.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:30.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:30.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:30.557+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:31.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:31.437+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:31.528 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:31.528+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:32.467 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:32.467+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:32.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:32.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:33.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:33.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:33.562 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:33.563+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:34.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:34.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:34.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:34.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:35.504 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:35.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:35.638 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:35.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:36.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:36.475+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:36.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:36.627+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:37.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:37.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:37.580 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:37.580+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:38.438 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:38.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:38.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:38.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:39.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:39.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:39.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:39.583+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:40.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:40.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:40.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:40.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:41.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:41.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:41.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:41.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:42.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:42.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:42.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:42.639+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:43.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:43.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:43.670 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:43.670+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:44.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:44.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:44.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:44.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:45.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:45.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:45.633 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:45.633+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:46.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:46.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:46.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:46.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:47.509 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:47.509+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:47.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:47.644+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:48.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:48.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:48.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:48.603+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:49.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:49.455+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:49.598 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:49.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:50.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:50.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:50.609 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:50.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:51.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:51.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:51.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:51.625+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:52.441 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:52.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:52.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:52.613+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:53.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:53.399+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:53.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:53.647+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:54.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:54.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:54.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:54.696+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:55.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:55.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:55.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:55.678+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:56.453 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:56.453+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:56.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:56.634+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:57.463 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:57.463+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:57.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:57.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:58.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:58.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:58.584 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:58.584+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:59.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:54:59.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:54:59.622 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:54:59.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:00.574 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:00.575+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:00.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:00.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:01.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:01.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:01.642 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:01.643+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:02.604 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:02.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:02.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:02.641+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:03.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:03.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:03.686 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:03.687+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:04.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:04.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:04.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:04.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:05.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:05.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:05.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:05.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:06.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:06.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:06.634 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:06.635+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:07.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:07.572+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:07.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:07.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:08.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:08.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:08.708 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:08.709+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:09.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:09.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:09.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:09.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:10.579 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:10.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:10.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:10.664+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:11.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:11.559+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:11.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:11.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:12.521 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:12.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:12.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:12.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:13.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:13.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:13.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:13.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:14.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:14.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:14.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:14.681+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:15.527 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:15.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:15.650 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:15.651+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:16.520 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:16.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:16.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:16.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:17.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:17.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:17.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:17.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:18.499 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:18.500+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:18.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:18.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:19.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:19.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:19.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:19.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:20.578 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:20.579+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:20.639 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:20.640+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:21.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:21.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:21.678 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:21.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:22.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:22.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:22.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:22.677+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:23.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:23.613+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:23.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:23.708+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:24.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:24.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:24.671 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:24.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:25.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:25.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:25.659 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:25.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:26.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:26.657+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:26.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:26.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:27.689 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:27.691+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:27.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:27.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:28.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:28.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:28.703 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:28.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:29.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:29.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:29.660 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:29.660+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:30.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:30.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:30.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:30.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:31.630 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:31.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:31.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:31.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:32.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:32.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:32.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:32.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:33.602 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:33.603+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:33.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:33.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:34.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:34.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:34.694 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:34.695+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:35.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:35.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:35.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:35.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:36.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:36.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:36.690 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:36.690+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:37.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:37.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:37.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:37.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:38.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:38.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:38.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:38.686+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:39.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:39.580+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:39.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:39.638+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:40.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:40.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:40.651 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:40.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:41.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:41.555+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:41.625 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:41.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:42.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:42.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:42.641 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:42.642+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:43.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:43.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:43.631 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:43.632+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:44.573 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:44.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:44.648 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:44.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:45.563 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:45.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:45.676 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:45.676+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:46.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:46.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:46.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:46.661+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:47.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:47.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:47.637 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:47.637+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:48.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:48.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:48.665 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:48.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:49.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:49.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:49.672 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:49.672+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:50.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:50.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:50.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:50.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:51.592 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:51.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:51.684 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:51.684+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:52.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:52.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:52.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:52.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:53.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:53.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:53.718 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:53.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:54.529 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:54.530+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:54.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:54.737+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:55.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:55.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:55.711 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:55.711+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:56.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:56.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:56.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:56.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:57.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:57.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:57.769 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:57.769+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:58.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:58.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:58.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:58.807+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:59.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:55:59.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:55:59.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:55:59.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:00.541 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:00.542+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:00.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:00.796+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:01.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:01.581+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:01.825 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:01.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:02.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:02.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:02.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:02.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:03.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:03.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:03.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:03.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:04.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:04.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:04.884 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:04.884+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:05.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:05.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:05.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:05.928+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:06.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:06.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:06.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:06.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:07.691 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:07.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:07.923 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:07.923+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:08.675 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:08.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:08.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:08.907+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:09.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:09.657+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:09.953 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:09.953+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:10.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:10.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:10.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:10.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:11.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:11.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:11.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:11.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:12.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:12.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:12.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:12.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:13.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:13.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:13.867 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:13.868+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:14.596 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:14.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:14.854 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:14.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:15.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:15.549+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:15.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:15.813+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:16.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:16.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:16.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:16.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:17.562 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:17.563+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:17.765 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:17.767+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:18.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:18.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:18.722 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:18.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:19.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:19.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:19.715 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:19.716+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:20.598 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:20.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:20.752 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:20.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:21.585 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:21.586+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:21.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:21.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:22.564 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:22.565+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:22.826 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:22.827+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:23.567 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:23.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:23.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:23.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:24.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:24.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:24.779 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:24.780+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:25.539 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:25.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:25.790 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:25.791+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:26.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:26.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:26.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:26.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:27.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:27.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:27.791 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:27.792+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:28.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:28.570+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:28.793 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:28.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:29.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:29.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:29.827 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:29.828+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:30.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:30.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:30.858 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:30.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:31.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:31.587+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:31.887 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:31.888+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:32.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:32.577+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:32.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:32.902+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:33.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:33.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:33.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:33.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:34.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:34.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:34.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:34.963+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:35.555 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:35.556+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:36.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:36.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:36.590 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:36.592+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:36.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:36.981+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:37.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:37.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:37.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:37.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:38.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:38.544+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:39.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:39.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:39.583 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:39.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:39.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:39.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:40.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:40.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:40.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:40.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:41.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:41.648+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:41.934 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:41.935+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:42.601 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:42.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:42.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:42.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:43.623 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:43.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:43.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:43.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:44.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:44.599+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:45.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:45.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:45.614 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:45.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:46.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:46.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:46.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:46.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:46.967 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:46.967+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:47.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:47.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:47.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:47.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:48.666 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:48.667+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:48.995 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:48.995+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:49.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:49.701+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:49.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:49.969+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:50.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:50.742+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:50.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:50.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:51.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:51.755+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:51.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:51.993+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:52.756 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:52.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:53.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:53.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:53.795 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:53.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:54.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:54.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:54.835 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:54.835+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:55.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:55.043+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:55.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:55.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:56.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:56.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:56.897 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:56.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:57.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:57.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:57.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:57.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:57.998 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:57.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:58.901 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:58.901+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:58.971 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:56:58.971+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:56:59.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:56:59.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:00.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:00.008+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:00.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:00.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:01.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:01.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:01.977 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:01.977+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:02.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:02.006+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:02.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:02.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:03.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:03.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:04.012 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:04.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:04.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:04.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:05.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:05.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:05.038 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:05.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:05.999 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:06.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:06.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:06.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:07.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:07.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:07.066 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:07.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:08.020 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:08.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:08.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:08.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:09.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:09.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:09.052 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:09.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:10.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:10.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:10.095 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:10.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:11.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:11.061+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:11.144 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:11.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:12.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:12.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:12.117 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:12.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:13.017 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:13.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:13.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:13.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:13.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:13.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:14.136 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:14.136+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:14.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:14.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:15.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:15.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:15.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:15.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:16.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:16.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:16.955 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:16.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:17.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:17.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:17.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:17.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:18.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:18.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:18.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:18.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:19.008 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:19.009+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:19.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:19.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:19.964 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:19.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:20.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:20.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:21.008 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:21.009+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:21.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:21.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:22.006 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:22.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:23.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:22.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:23.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:23.039+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:23.984 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:23.985+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:24.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:24.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:25.000 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:25.000+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:25.035 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:25.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:25.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:25.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:25.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:25.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:27.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:27.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:27.023 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:27.023+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:28.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:28.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:28.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:28.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:28.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:28.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:29.017 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:29.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:30.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:30.017+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:30.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:30.051+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:31.032 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:31.033+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:31.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:31.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:32.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:32.031+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:32.076 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:32.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:32.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:32.982+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:33.114 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:33.115+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:33.944 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:33.945+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:34.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:34.072+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:34.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:34.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:35.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:35.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:35.896 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:35.897+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:36.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:36.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:36.918 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:36.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:37.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:37.045+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:37.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:37.879+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:38.065 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:38.066+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:38.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:38.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:39.112 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:39.114+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:39.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:39.964+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:40.107 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:40.108+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:40.987 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:40.988+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:41.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:41.149+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:41.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:41.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:42.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:42.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:42.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:42.955+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:43.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:43.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:43.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:43.959+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:44.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:44.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:44.989 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:44.990+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:45.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:45.165+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:45.982 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:45.983+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:46.174 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:46.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:46.951 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:46.952+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:47.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:47.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:47.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:47.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:48.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:48.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:48.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:48.970+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:49.137 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:49.138+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:49.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:49.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:50.104 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:50.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:50.931 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:50.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:51.068 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:51.069+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:51.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:51.969+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:52.071 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:52.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:52.991 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:52.992+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:53.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:53.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:54.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:54.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:54.085 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:54.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:55.039 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:55.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:55.046 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:55.046+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:56.063 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:56.064+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:56.072 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:56.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:57.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:57.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:57.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:57.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:58.002 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:58.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:58.030 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:58.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:58.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:57:58.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:57:58.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:57:58.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:00.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:00.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:00.031 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:00.032+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:01.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:01.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:01.037 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:01.038+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:01.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:01.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:02.069 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:02.070+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:02.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:02.910+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:03.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:03.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:03.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:03.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:04.038 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:04.039+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:04.885 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:04.885+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:05.028 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:05.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:05.900 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:05.901+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:06.016 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:06.016+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:06.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:06.948+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:07.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:07.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:07.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:07.944+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:08.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:08.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:08.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:08.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:09.104 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:09.105+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:09.963 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:09.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:10.127 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:10.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:10.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:10.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:11.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:11.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:11.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:11.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:12.121 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:12.121+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:13.010 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:13.011+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:13.166 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:13.166+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:14.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:14.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:14.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:14.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:14.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:14.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:15.217 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:15.217+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:15.968 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:15.968+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:16.263 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:16.264+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:16.952 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:16.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:17.228 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:17.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:17.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:17.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:18.277 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:18.277+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:19.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:19.016+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:19.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:19.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:20.028 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:20.028+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:20.262 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:20.263+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:21.016 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:21.017+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:21.282 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:21.282+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:21.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:21.972+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:22.259 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:22.259+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:22.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:22.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:23.221 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:23.221+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:23.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:23.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:24.173 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:24.173+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:25.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:25.014+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:25.194 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:25.194+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:25.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:25.965+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:26.230 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:26.230+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:26.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:26.987+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:27.229 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:27.229+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:28.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:28.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:28.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:28.241+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:28.976 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:28.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:29.246 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:29.246+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:29.993 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:29.994+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:30.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:30.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:30.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:30.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:31.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:31.287+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:31.946 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:31.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:32.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:32.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:32.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:32.960+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:33.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:33.295+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:33.922 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:33.922+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:34.327 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:34.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:34.905 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:34.906+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:35.299 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:35.300+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:35.876 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:35.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:36.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:36.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:36.848 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:36.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:37.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:37.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:37.890 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:37.890+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:38.294 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:38.294+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:38.874 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:38.874+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:39.318 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:39.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:39.847 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:39.848+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:40.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:40.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:40.804 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:40.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:41.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:41.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:41.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:41.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:42.368 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:42.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:42.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:42.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:43.405 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:43.407+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:43.868 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:43.869+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:44.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:44.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:44.873 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:44.875+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:45.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:45.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:45.899 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:45.900+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:46.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:46.356+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:46.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:46.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:47.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:47.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:47.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:47.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:48.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:48.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:48.948 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:48.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:49.366 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:49.368+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:49.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:49.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:50.373 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:50.374+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:50.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:50.976+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:51.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:51.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:52.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:52.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:52.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:52.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:52.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:52.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:53.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:53.452+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:53.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:53.955+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:54.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:54.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:54.925 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:54.926+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:55.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:55.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:55.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:55.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:56.468 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:56.469+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:56.978 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:56.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:57.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:57.443+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:58.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:58.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:58.455 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:58.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:59.000 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:59.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:59.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:58:59.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:58:59.996 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:58:59.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:00.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:00.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:01.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:01.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:01.437 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:01.438+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:02.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:02.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:02.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:02.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:03.079 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:03.080+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:03.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:03.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:04.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:04.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:04.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:04.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:05.171 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:05.172+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:05.505 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:05.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:06.199 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:06.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:06.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:06.472+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:07.190 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:07.190+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:07.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:07.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:08.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:08.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:08.507 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:08.507+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:09.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:09.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:09.478 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:09.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:10.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:10.268+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:10.525 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:10.525+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:11.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:11.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:11.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:11.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:12.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:12.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:12.533 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:12.533+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:13.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:13.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:13.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:13.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:14.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:14.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:14.482 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:14.482+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:15.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:15.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:15.489 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:15.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:16.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:16.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:16.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:16.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:17.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:17.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:17.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:17.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:18.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:18.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:18.404 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:18.404+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:19.228 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:19.228+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:19.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:19.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:20.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:20.229+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:20.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:20.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:21.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:21.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:21.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:21.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:22.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:22.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:22.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:22.439+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:23.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:23.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:23.430 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:23.430+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:24.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:24.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:24.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:24.397+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:25.250 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:25.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:25.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:25.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:26.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:26.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:26.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:26.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:27.173 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:27.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:27.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:27.390+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:28.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:28.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:28.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:28.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:29.191 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:29.191+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:29.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:29.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:30.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:30.232+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:30.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:30.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:31.230 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:31.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:31.422 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:31.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:32.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:32.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:32.385 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:32.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:33.211 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:33.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:33.389 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:33.389+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:34.183 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:34.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:34.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:34.384+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:35.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:35.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:35.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:35.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:36.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:36.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:36.329 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:36.329+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:37.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:37.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:37.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:37.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:38.209 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:38.210+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:38.382 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:38.382+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:39.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:39.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:39.383 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:39.383+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:40.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:40.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:40.343 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:40.343+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:41.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:41.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:41.319 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:41.319+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:42.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:42.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:42.288 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:42.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:43.186 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:43.186+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:43.306 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:43.306+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:44.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:44.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:44.278 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:44.279+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:45.148 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:45.148+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:45.316 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:45.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:46.167 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:46.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:46.363 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:46.363+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:47.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:47.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:47.357 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:47.357+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:48.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:48.251+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:48.314 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:48.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:49.288 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:49.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:49.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:49.365+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:50.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:50.263+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:50.333 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:50.333+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:51.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:51.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:51.331 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:51.331+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:52.275 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:52.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:52.364 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:52.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:53.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:53.323+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:53.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:53.362+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:54.340 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:54.340+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:54.354 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:54.354+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:55.351 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:55.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:55.390 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:55.391+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:56.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:56.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:56.384 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:56.385+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:57.293 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:57.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:57.346 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:57.347+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:58.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:58.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:58.313 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:58.315+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:59.271 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T02:59:59.272+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T02:59:59.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T02:59:59.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:00.268 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:00.270+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:00.270 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:00.271+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:01.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:01.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:01.305 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:01.307+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:02.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:02.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:02.310 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:02.311+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:03.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:03.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:03.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:03.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:04.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:04.176+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:04.359 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:04.360+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:05.176 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:05.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:05.409 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:05.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:06.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:06.181+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:06.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:06.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:07.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:07.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:07.439 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:07.440+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:08.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:08.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:08.483 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:08.484+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:09.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:09.277+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:09.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:09.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:10.318 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:10.319+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:10.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:10.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:11.324 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:11.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:11.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:11.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:12.338 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:12.339+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:12.421 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:12.422+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:13.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:13.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:13.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:13.446+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:14.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:14.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:14.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:14.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:15.268 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:15.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:15.460 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:15.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:16.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:16.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:16.492 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:16.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:17.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:17.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:17.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:17.451+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:18.159 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:18.161+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:18.495 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:18.496+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:19.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:19.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:19.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:19.504+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:20.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:20.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:20.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:20.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:21.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:21.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:21.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:21.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:22.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:22.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:22.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:22.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:23.082 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:23.082+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:23.513 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:23.513+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:24.074 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:24.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:24.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:24.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:25.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:25.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:25.558 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:25.558+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:26.154 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:26.154+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:26.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:26.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:27.122 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:27.122+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:27.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:27.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:28.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:28.167+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:28.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:28.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:29.160 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:29.160+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:29.524 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:29.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:30.169 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:30.169+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:30.485 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:30.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:31.215 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:31.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:31.516 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:31.516+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:32.175 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:32.175+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:32.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:32.488+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:33.185 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:33.185+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:33.537 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:33.537+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:34.145 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:34.145+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:34.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:34.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:35.150 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:35.150+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:35.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:35.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:36.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:36.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:36.569 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:36.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:37.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:37.240+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:37.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:37.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:38.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:38.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:38.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:38.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:39.222 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:39.223+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:39.547 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:39.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:40.225 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:40.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:40.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:40.593+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:41.217 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:41.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:41.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:41.618+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:42.219 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:42.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:42.640 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:42.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:43.172 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:43.173+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:43.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:43.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:44.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:44.217+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:44.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:44.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:45.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:45.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:45.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:45.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:46.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:46.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:46.624 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:46.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:47.197 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:47.198+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:47.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:47.604+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:48.152 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:48.152+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:48.605 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:48.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:49.139 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:49.139+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:49.591 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:49.591+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:50.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:50.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:50.597 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:50.598+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:51.129 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:51.129+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:51.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:51.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:52.111 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:52.112+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:52.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:52.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:53.088 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:53.088+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:53.617 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:53.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:54.105 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:54.105+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:54.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:54.629+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:55.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:55.061+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:55.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:55.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:56.044 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:56.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:56.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:56.646+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:57.005 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:57.005+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:57.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:57.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:58.037 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:58.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:58.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:58.585+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:59.027 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:00:59.027+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:00:59.589 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:00:59.590+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:00.075 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:00.075+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:00.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:00.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:01.125 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:01.126+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:01.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:01.625+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:02.168 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:02.168+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:02.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:02.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:03.123 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:03.123+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:03.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:03.626+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:04.170 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:04.170+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:04.584 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:04.584+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:05.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:05.158+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:05.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:05.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:06.184 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:06.184+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:06.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:06.633+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:07.232 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:07.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:07.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:07.658+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:08.202 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:08.203+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:08.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:08.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:09.229 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:09.230+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:09.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:09.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:10.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:10.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:10.674 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:10.675+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:11.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:11.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:11.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:11.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:12.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:12.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:12.679 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:12.681+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:13.261 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:13.262+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:13.648 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:13.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:14.285 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:14.287+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:14.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:14.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:15.292 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:15.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:15.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:15.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:16.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:16.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:16.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:16.596+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:17.360 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:17.361+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:17.644 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:17.645+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:18.343 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:18.344+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:18.599 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:18.600+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:19.361 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:19.363+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:19.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:19.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:20.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:20.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:20.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:20.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:21.382 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:21.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:21.625 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:21.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:22.350 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:22.352+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:22.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:22.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:23.334 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:23.335+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:23.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:23.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:24.357 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:24.358+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:24.561 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:24.562+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:25.375 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:25.376+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:25.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:25.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:26.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:26.328+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:26.519 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:26.521+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:27.330 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:27.331+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:27.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:27.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:28.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:28.289+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:28.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:28.567+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:29.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:29.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:29.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:29.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:30.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:30.248+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:30.587 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:30.588+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:31.203 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:31.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:31.577 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:31.578+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:32.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:32.225+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:32.557 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:32.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:33.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:33.227+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:33.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:33.545+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:34.188 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:34.188+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:34.543 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:34.543+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:35.194 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:35.194+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:35.535 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:35.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:36.227 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:36.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:36.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:36.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:37.247 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:37.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:37.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:37.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:38.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:38.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:38.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:38.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:39.240 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:39.241+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 150 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:39.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:39.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:40.253 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:40.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:40.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:40.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:41.290 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:41.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:41.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:41.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:42.258 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:42.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:42.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:42.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:43.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:43.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:43.397 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:43.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:44.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:44.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:44.402 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:44.402+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:45.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:45.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:45.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:45.417+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:46.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:46.260+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:46.403 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:46.403+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:47.294 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:47.294+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:47.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:47.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:48.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:48.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:48.388 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:48.388+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:49.245 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:49.245+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:49.429 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:49.429+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:50.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:50.275+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:50.451 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:50.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:51.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:51.257+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:51.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:51.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:52.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:52.303+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:52.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:52.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:53.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:53.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:53.548 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:53.548+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:54.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:54.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:54.514 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:54.514+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:55.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:55.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:55.536 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:55.536+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:56.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:56.341+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:56.582 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:56.583+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:57.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:57.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:57.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:57.538+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:58.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:58.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:58.552 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:58.552+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:59.337 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:01:59.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:01:59.517 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:01:59.517+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:00.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:00.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:00.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:00.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:01.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:01.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:01.476 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:01.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:02.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:02.309+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:02.491 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:02.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:03.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:03.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:03.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:03.540+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:04.315 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:04.315+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:04.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:04.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:05.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:05.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:05.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:05.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:06.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:06.313+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:06.595 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:06.595+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:07.305 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:07.306+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:07.616 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:07.616+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:08.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:08.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:08.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:08.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:09.279 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:09.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 97 slow ops, oldest is osd_op(osd.1.8:1919 2.0 2:1f906503:::rbd_data.107b81200e13.0000000000000043:head [copy-from ver 1482 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:09.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:09.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:10.235 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:10.236+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:10.649 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:10.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:11.244 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:11.244+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:11.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:11.683+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:12.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:12.246+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:12.650 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:12.650+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:13.239 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:13.239+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:13.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:13.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:14.274 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:14.274+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:14.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:14.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:15.320 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:15.320+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:15.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:15.642+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:16.304 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:16.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:16.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:16.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:17.328 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:17.329+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:17.653 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:17.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:18.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:18.355+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:18.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:18.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:19.321 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:19.321+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:19.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:19.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:20.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:20.366+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:20.678 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:20.678+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:21.348 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:21.349+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:21.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:21.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:22.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:22.316+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:22.654 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:22.655+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:23.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:23.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:23.705 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:23.706+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:24.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:24.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:24.696 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:24.697+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:25.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:25.305+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:25.658 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:25.659+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:26.309 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:26.310+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:26.683 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:26.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:27.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:27.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:27.688 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:27.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:28.356 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:28.357+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:28.730 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:28.731+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:29.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:29.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:29.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:29.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:30.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:30.381+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:30.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:30.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:31.368 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:31.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:31.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:31.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:32.415 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:32.416+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:32.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:32.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:33.439 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:33.440+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:33.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:33.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:34.397 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:34.398+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:34.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:34.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:35.402 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:35.403+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:35.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:35.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:36.389 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:36.391+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:36.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:36.672+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:37.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:37.367+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:37.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:37.653+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:38.355 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:38.356+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:38.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:38.687+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:39.323 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:39.325+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:39.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:39.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:40.297 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:40.299+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:40.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:40.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:41.326 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:41.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:41.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:41.628+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:42.299 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:42.301+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:42.581 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:42.582+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:43.284 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:43.285+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:43.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:43.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:44.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:44.270+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:44.546 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:44.547+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:45.303 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:45.304+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:45.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:45.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:46.276 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:46.276+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:46.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:46.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:47.273 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:47.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:47.610 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:47.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:48.322 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:48.322+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:48.642 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:48.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:49.327 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:49.327+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:49.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:49.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:50.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:50.283+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:50.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:50.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:51.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:51.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:51.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:51.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:52.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:52.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:52.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:52.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:53.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:53.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:53.736 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:53.736+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:54.220 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:54.220+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:54.718 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:54.718+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:55.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:55.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:55.724 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:55.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:56.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:56.182+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:56.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:56.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:57.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:57.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:57.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:57.690+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:58.157 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:58.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:58.684 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:58.684+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:59.182 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:02:59.183+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:02:59.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:02:59.652+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:00.224 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:00.224+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:00.676 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:00.676+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:01.210 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:01.211+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:01.692 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:01.693+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:02.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:02.243+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:02.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:02.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:03.206 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:03.206+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:03.626 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:03.627+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:04.178 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:04.178+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:04.611 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:04.611+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:05.153 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:05.153+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:05.651 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:05.651+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:06.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:06.120+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:06.646 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:06.647+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:07.121 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:07.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:07.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:07.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:08.102 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:08.102+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:08.636 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:08.636+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:09.106 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:09.106+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:09.612 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:09.612+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:10.124 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:10.124+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:10.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:10.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:11.166 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:11.166+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:11.634 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:11.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:12.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:12.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:12.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:12.680+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:13.226 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:13.226+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:13.695 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:13.694+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:14.216 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:14.216+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:14.735 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:14.735+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:15.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:15.208+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:15.689 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:15.689+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:16.233 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:16.233+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:16.672 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:16.673+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:17.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:17.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:17.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:17.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:18.205 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:18.204+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:18.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:18.635+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:19.212 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:19.213+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:19.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:19.630+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:20.249 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:20.249+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:20.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:20.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:21.265 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:21.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:21.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:21.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:22.223 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:22.219+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:22.663 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:22.663+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:23.221 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:23.222+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:23.669 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:23.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:24.257 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:24.258+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:24.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:24.665+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:25.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:25.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:25.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:25.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:26.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:26.266+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:26.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:26.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:27.237 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:27.237+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:27.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:27.609+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:28.196 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:28.196+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:28.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:28.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:29.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:29.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:29.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:29.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:30.177 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:30.177+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:30.531 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:30.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:31.164 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:31.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:31.534 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:31.534+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:32.213 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:32.214+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:32.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:32.557+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:33.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:33.201+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:33.571 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:33.571+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:34.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:34.235+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:34.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:34.561+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:35.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:35.253+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:35.553 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:35.554+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:36.204 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:36.205+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:36.549 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:36.551+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:37.246 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:37.247+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:37.545 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:37.546+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:38.287 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:38.288+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:38.568 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:38.569+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:39.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:39.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:39.600 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:39.601+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:40.316 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:40.317+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:40.559 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:40.560+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:41.313 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:41.314+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:41.572 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:41.573+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:42.311 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:42.312+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:42.566 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:42.568+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:43.310 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:43.311+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:43.523 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:43.524+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:44.341 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:44.342+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:44.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:44.529+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:45.344 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:45.345+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:45.530 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:45.531+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:46.325 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:46.326+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:46.538 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:46.539+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:47.336 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:47.337+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:47.496 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:47.497+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:48.366 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:48.368+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:48.447 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:48.449+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:49.363 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:49.364+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:49.443 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:49.445+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:50.403 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:50.405+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:50.475 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:50.476+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:51.387 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:51.385+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:51.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:51.480+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:52.421 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:52.422+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:52.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:52.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:53.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:53.415+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:53.448 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:53.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:54.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:54.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:54.469 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:54.470+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:55.470 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:55.471+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:55.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:55.506+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:56.500 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:56.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:56.513 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:56.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:57.472 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:57.473+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:57.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:57.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:58.434 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:58.434+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:58.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:58.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:59.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:03:59.392+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:03:59.565 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:03:59.565+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:00.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:00.398+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:00.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:00.570+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:01.435 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:01.435+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:01.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:01.605+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:02.442 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:02.442+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:02.595 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:02.595+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:03.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:03.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:03.604 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:03.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:04.380 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:04.380+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:04.587 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:04.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:05.387 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:05.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:05.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:05.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:06.353 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:06.353+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:06.610 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:06.610+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:07.376 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:07.376+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:07.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:07.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:08.367 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:08.367+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:08.577 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:08.577+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:09.393 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:09.393+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:09.619 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:09.619+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:10.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:10.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:10.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:10.648+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:11.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:11.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:11.673 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:11.673+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:12.445 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:12.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:12.698 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:12.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:13.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:13.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:13.685 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:13.685+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:14.408 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:14.408+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:14.720 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:14.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:15.426 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:15.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:15.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:15.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:16.416 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:16.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:16.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:16.748+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:17.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:17.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:17.794 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:17.794+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:18.419 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:18.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:18.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:18.806+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:19.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:19.406+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:19.782 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:19.781+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:20.431 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:20.431+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:20.746 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:20.746+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:21.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:21.386+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:21.763 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:21.763+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:22.349 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:22.349+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:22.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:22.717+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:23.365 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:23.366+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:23.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:23.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:24.411 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:24.411+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:24.680 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:24.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:25.444 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:25.444+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:25.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:25.645+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:26.420 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:26.420+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:26.616 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:26.616+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:27.440 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:27.441+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:27.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:27.628+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:28.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:28.424+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:28.621 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:28.622+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:29.436 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:29.436+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:29.590 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:29.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:30.413 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:30.413+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:30.567 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:30.567+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:31.456 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:31.456+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:31.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:31.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:32.461 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:32.461+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:32.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:32.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:33.501 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:33.501+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:33.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:33.548+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:34.465 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:34.465+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:34.505 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:34.505+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:35.479 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:35.479+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:35.551 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:35.551+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:36.481 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:36.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:36.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:36.522+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:37.506 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:37.506+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:37.514 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:37.514+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:38.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:38.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:38.522 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:38.522+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:39.532 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:39.532+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:39.539 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:39.540+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:40.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:40.508+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:40.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:40.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:41.484 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:41.485+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:41.626 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:41.626+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:42.493 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:42.493+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:42.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:42.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:43.450 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:43.450+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:43.620 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:43.621+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:44.464 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:44.464+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:44.603 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:44.604+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:45.425 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:45.426+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:45.578 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:45.578+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:46.398 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:46.400+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:46.589 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:46.590+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:47.362 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:47.364+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:47.629 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:47.630+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:48.407 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:48.409+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:48.611 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:48.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:49.360 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:49.361+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:49.594 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:49.596+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:50.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:50.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:50.614 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:50.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:51.322 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:51.324+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:51.600 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:51.600+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:52.312 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:52.313+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:52.605 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:52.606+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:53.269 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:53.271+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:53.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:53.615+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:54.287 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:54.288+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:54.647 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:54.649+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:55.304 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:55.305+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:55.630 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:55.631+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:56.323 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:56.325+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:56.653 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:56.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:57.328 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:57.330+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:57.644 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:57.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:58.326 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:58.327+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:58.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:58.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:59.369 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:04:59.370+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:04:59.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:04:59.665+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:00.399 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:00.401+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:00.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:00.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:01.446 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:01.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:01.687 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:01.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:02.424 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:02.425+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:02.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:02.679+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:03.378 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:03.379+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:03.688 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:03.689+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:04.348 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:04.348+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:04.721 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:04.722+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:05.386 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:05.387+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:05.679 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:05.680+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:06.415 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:06.416+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:06.654 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:06.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:07.448 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:07.447+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:07.926 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:07.698+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:08.480 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:08.481+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:08.717 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:08.718+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:09.469 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:09.470+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:09.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:09.759+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:10.502 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:10.502+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:10.757 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:10.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:11.512 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:11.512+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:11.732 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:11.731+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:12.490 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:12.491+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:12.692 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:12.693+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:13.540 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:13.541+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:13.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:13.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:14.494 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:14.494+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:14.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:14.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:15.515 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:15.515+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:15.753 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:15.754+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:16.488 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:16.489+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:16.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:16.740+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:17.458 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:17.458+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:17.756 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:17.757+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:18.503 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:18.503+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:18.749 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:18.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:19.528 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:19.528+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:19.773 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:19.774+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:20.526 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:20.526+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:20.761 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:20.761+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:21.565 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:21.566+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:21.750 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:21.750+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:22.607 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:22.607+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:22.736 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:22.736+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:23.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:23.619+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:23.712 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:23.712+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:24.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:24.639+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:24.702 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:24.702+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:25.675 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:25.675+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:25.686 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:25.686+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:26.641 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:26.641+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:26.655 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:26.655+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:27.670 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:27.670+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:27.699 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:27.700+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:28.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:28.658+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:28.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:28.715+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:29.628 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:29.629+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:29.733 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:29.734+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:30.612 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:30.612+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:30.759 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:30.759+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:31.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:31.568+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:31.784 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:31.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:32.549 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:32.549+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:32.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:32.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:33.593 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:33.593+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:33.794 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:33.794+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:34.585 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:34.586+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:34.807 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:34.807+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:35.607 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:35.607+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:35.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:35.854+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:36.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:36.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:36.885 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:36.886+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:37.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:37.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:37.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:37.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:38.495 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:38.496+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:38.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:38.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:39.478 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:39.479+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:39.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:39.942+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:40.442 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:40.442+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:40.938 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:40.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:41.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:41.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:41.950 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:41.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:42.435 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:42.436+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:42.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:42.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:43.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:43.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:44.002 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:44.002+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:44.423 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:44.424+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:44.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:44.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:45.425 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:45.425+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:45.932 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:45.932+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:46.422 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:46.418+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:46.953 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:46.953+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:47.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:47.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:47.968 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:47.968+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:48.365 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:48.365+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:48.980 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:48.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:49.394 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:49.395+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:50.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:50.030+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:50.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:50.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:51.041 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:51.042+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:51.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:51.451+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:52.025 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:52.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:52.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:52.412+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:53.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:53.012+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:53.369 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:53.369+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:53.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:53.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:54.400 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:54.400+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:55.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:55.006+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:55.383 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:55.384+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:55.981 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:55.981+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:56.358 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:56.359+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:56.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:56.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:57.391 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:57.392+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:57.947 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:57.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:58.395 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:58.396+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:58.902 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:58.904+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:59.427 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:05:59.429+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:05:59.861 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:05:59.863+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:00.433 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:00.435+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:00.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:00.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:01.447 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:01.448+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:01.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:01.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:02.412 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:02.413+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:02.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:02.922+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:03.401 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:03.402+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:03.906 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:03.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:04.436 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:04.438+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:04.889 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:04.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:05.471 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:05.473+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:05.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:05.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:06.484 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:06.485+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:06.904 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:06.905+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:07.507 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:07.508+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:07.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:07.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:08.516 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:08.517+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:08.824 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:08.825+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:09.561 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:09.562+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:09.790 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:09.791+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:10.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:10.555+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:10.746 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:10.748+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:11.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:11.545+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:11.713 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:11.714+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:12.554 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:12.556+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:12.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:12.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:13.586 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:13.588+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:13.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:13.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:14.541 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:14.542+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:14.757 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:14.758+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:15.573 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:15.575+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:15.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:15.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:16.571 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:16.573+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:16.793 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:16.795+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:17.575 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:17.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:17.830 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:17.831+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:18.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:18.559+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:18.801 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:18.803+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:19.527 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:19.529+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:19.761 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:19.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:20.510 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:20.511+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:20.803 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:20.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:21.537 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:21.538+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:21.808 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:21.809+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:22.568 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:22.569+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:22.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:22.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:23.521 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:23.521+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:23.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:23.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:24.534 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:24.534+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:24.760 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:24.760+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:25.544 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:25.544+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:25.780 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:25.780+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:26.592 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:26.592+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:26.796 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:26.796+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:27.599 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:27.599+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:27.832 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:27.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:28.601 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:28.601+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:28.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:28.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:29.618 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:29.618+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:29.920 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:29.920+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:30.576 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:30.576+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:30.878 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:30.878+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:31.624 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:31.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:31.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:31.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:32.663 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:32.663+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:32.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:32.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:33.623 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:33.624+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:33.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:33.852+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:34.645 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:34.646+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:34.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:34.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:35.682 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:35.683+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:35.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:35.871+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:36.705 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:36.706+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:36.872 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:36.873+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:37.693 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:37.694+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:37.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:37.917+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:38.661 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:38.662+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:38.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:38.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:39.613 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:39.614+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:39.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:39.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:40.635 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:40.636+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:40.871 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:40.872+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:41.652 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:41.652+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:41.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:41.823+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:42.696 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:42.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:42.837 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:42.837+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:43.727 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:43.727+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:43.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:43.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:44.740 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:44.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:44.819 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:44.820+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:45.781 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:45.782+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:45.817 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:45.818+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:46.743 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:46.744+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:46.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:46.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:47.752 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:47.752+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:47.789 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:47.790+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:48.762 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:48.762+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:48.824 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:48.825+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:49.732 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:49.732+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:49.821 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:49.821+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:50.755 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:50.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:50.816 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:50.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:51.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:51.754+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:51.859 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:51.860+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:52.748 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:52.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:52.849 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:52.849+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:53.723 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:53.724+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:53.872 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:53.873+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:54.699 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:54.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:54.828 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:54.829+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:55.707 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:55.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:55.841 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:55.841+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:56.708 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:56.708+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:56.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:56.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:57.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:57.698+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:57.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:57.783+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:58.665 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:58.666+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:58.783 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:58.784+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:59.668 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:06:59.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:06:59.758 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:06:59.758+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:00.687 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:00.688+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:00.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:00.724+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:01.660 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:01.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:01.741 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:01.741+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:02.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:02.644+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:02.697 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:02.697+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:03.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:03.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:03.719 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:03.720+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:04.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:04.614+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:04.730 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:04.730+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:05.637 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:05.638+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:05.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:05.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:06.632 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:06.632+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:06.815 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:06.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:07.620 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:07.621+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:07.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:07.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:08.643 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:08.643+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:08.835 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:08.836+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:09.639 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:09.640+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:09.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:09.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:10.606 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:10.606+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:10.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:10.820+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:11.629 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:11.631+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:11.857 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:11.859+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:12.615 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:12.617+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:12.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:12.855+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:13.618 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:13.620+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:13.818 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:13.819+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:14.647 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:14.649+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:14.775 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:14.776+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:15.608 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:15.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:15.814 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:15.816+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:16.622 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:16.624+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:16.803 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:16.804+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:17.621 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:17.623+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:17.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:17.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:18.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:18.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:18.817 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:18.818+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:19.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:19.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:19.807 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:19.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:20.613 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:20.615+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:20.810 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:20.811+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:21.609 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:21.610+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:21.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:21.847+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:22.633 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:22.634+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:22.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:22.865+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:23.681 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:23.682+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:23.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:23.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:24.667 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:24.669+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:24.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:24.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:25.652 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:25.654+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:25.937 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:25.939+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:26.635 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:26.637+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:26.960 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:26.961+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:27.659 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:27.661+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:27.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:27.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:28.701 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:28.703+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:28.982 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:28.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:29.715 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:29.717+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:29.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:29.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:30.697 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:30.699+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:30.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:31.001+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:31.729 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:31.730+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:31.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:31.988+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:32.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:32.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:32.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:32.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:33.754 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:33.756+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:33.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:33.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:34.799 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:34.800+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:34.988 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:34.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:35.838 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:35.839+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:35.986 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:35.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:36.826 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:36.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:37.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:37.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:37.877 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:37.877+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:38.001 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:38.002+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:38.924 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:38.924+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:39.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:39.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:39.915 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:39.915+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:39.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:39.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:40.940 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:40.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:40.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:40.946+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:41.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:41.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:41.933 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:41.934+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:42.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:42.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:42.944 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:42.945+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:43.891 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:43.891+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:43.983 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:43.983+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:44.869 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:44.870+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:44.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:44.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:45.848 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:45.848+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:45.991 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:45.992+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:46.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:46.884+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:47.024 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:47.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:47.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:47.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:48.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:48.074+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:48.892 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:48.892+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:49.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:49.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:49.888 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:49.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:50.049 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:50.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:50.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:50.934+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:51.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:51.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:51.976 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:51.976+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:52.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:52.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:52.933 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:52.933+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:53.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:53.037+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:53.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:53.965+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:54.073 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:54.073+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:54.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:54.962+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:55.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:55.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:55.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:55.979+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:56.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:56.025+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:57.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:57.019+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:57.051 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:57.052+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:58.022 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:58.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:58.027 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:58.027+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:58.983 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:58.984+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:59.055 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:07:59.055+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:07:59.937 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:07:59.938+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:00.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:00.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:00.961 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:00.961+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:01.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:01.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:01.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:01.966+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:02.043 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:02.044+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:02.936 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:02.937+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:03.077 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:03.077+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:03.922 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:03.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:04.069 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:04.070+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:04.925 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:04.926+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:05.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:05.035+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:05.975 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:05.975+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:06.018 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:06.018+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:07.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:07.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:07.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:07.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:07.979 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:07.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:08.025 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:08.026+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:08.943 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:08.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:09.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:09.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:09.942 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:09.943+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:10.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:10.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:10.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:10.978+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:11.041 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:11.042+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:12.019 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:12.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:12.033 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:12.034+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:13.056 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:13.057+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:13.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:13.062+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:14.060 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:14.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:14.064 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:14.065+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:15.033 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:15.033+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:15.109 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:15.110+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:16.062 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:16.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:16.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:16.094+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:17.050 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:17.050+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:17.111 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:17.112+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:18.081 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:18.082+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:18.084 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:18.085+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:19.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:19.048+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:19.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:19.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:20.059 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:20.060+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:20.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:20.098+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:21.013 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:21.013+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:21.078 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:21.079+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:21.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:21.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:22.114 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:22.114+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:22.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:22.985+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:23.109 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:23.110+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:23.945 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:23.947+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:24.126 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:24.127+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:24.939 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:24.941+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:25.122 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:25.124+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:25.902 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:25.904+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:26.118 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:26.120+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:26.915 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:26.916+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:27.097 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:27.099+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:27.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:27.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:28.076 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:28.077+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:28.972 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:28.973+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:29.059 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:29.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:29.930 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:29.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:30.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:30.073+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:30.928 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:30.929+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:31.079 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:31.081+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:31.914 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:31.915+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:32.061 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:32.063+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:32.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:32.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:33.018 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:33.020+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:33.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:33.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:34.007 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:34.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:34.987 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:34.989+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:35.024 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:35.025+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:36.009 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:36.010+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:36.011 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:36.013+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:37.040 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:37.041+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:37.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:37.050+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:38.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:38.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:38.057 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:38.059+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:39.047 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:39.049+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:39.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:39.068+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:40.030 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:40.032+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:40.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:40.076+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:41.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:41.023+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:41.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:41.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:42.013 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:42.015+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:42.034 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:42.036+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:42.965 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:42.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:43.021 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:43.022+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:43.946 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:43.948+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:44.023 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:44.024+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:44.905 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:44.907+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:44.975 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:44.977+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:45.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:45.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:45.931 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:45.932+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:46.846 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:46.847+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:46.918 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:46.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:47.875 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:47.876+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:47.887 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:47.888+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:48.852 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:48.853+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:48.863 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:48.864+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:49.843 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:49.844+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:49.910 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:49.911+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:50.871 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:50.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:50.884 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:50.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:51.865 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:51.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:51.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:51.908+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:52.859 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:52.859+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:52.942 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:52.943+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:53.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:53.842+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:53.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:53.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:54.831 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:54.832+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:54.981 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:54.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:55.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:55.804+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:55.997 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:55.998+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:56.789 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:56.790+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:56.965 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:56.966+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:57.811 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:57.812+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:57.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:57.980+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:58.775 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:58.776+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:58.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:08:58.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:08:59.788 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:08:59.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:00.003 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:00.003+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:00.823 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:00.824+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:00.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:00.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:01.841 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:01.841+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:01.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:01.999+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:02.827 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:02.828+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:02.990 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:02.991+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:03.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:03.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:03.985 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:03.986+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:04.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:04.750+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:04.999 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:05.000+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:05.728 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:05.729+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:05.961 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:05.962+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:06.739 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:06.740+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:06.958 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:06.959+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:07.690 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:07.691+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:07.949 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:07.950+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:08.711 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:08.711+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:08.955 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:08.956+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:09.741 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:09.741+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:09.984 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:09.984+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:10.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:10.707+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:10.979 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:10.979+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:11.700 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:11.700+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:11.940 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:11.940+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:12.712 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:12.713+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:12.913 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:12.913+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:13.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:13.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:13.919 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:13.920+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:14.783 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:14.784+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:14.895 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:14.895+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:15.797 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:15.798+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:15.850 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:15.851+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:16.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:16.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:16.877 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:16.878+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:17.749 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:17.749+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:17.845 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:17.846+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:18.720 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:18.720+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:18.856 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:18.857+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:19.743 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:19.744+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:19.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:19.837+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:20.767 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:20.768+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:20.831 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:20.832+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:21.788 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:21.788+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:21.810 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:21.810+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:22.770 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:22.770+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:22.784 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:22.785+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:23.774 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:23.774+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:23.796 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:23.797+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:24.748 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:24.749+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:24.785 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:24.786+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:25.791 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:25.792+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:25.797 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:25.798+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:26.764 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:26.765+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:26.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:26.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:27.738 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:27.739+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:27.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:27.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:28.704 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:28.703+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:28.867 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:28.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:29.731 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:29.732+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:29.913 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:29.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:30.723 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:30.723+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:30.923 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:30.923+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:31.733 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:31.734+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:31.893 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:31.894+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:32.777 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:32.778+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:32.857 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:32.858+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:33.770 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:33.772+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:33.828 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:33.829+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:34.813 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:34.814+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:34.825 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:34.826+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:35.823 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:35.823+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:35.864 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:35.865+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:36.853 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:36.854+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:36.853 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:36.855+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:37.806 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:37.808+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:37.849 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:37.851+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:38.820 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:38.822+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:38.868 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:38.869+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:39.870 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:39.872+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:39.917 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:39.918+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:40.864 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:40.866+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:40.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:40.881+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:41.855 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:41.856+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:41.869 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:41.871+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:42.883 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:42.885+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:42.907 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:42.909+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:43.866 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:43.867+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:43.950 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:43.952+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:44.912 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:44.913+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:44.956 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:44.958+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:45.880 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:45.882+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:45.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:45.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:46.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:46.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:46.929 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:46.930+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:47.945 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:47.947+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:47.962 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:47.964+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:48.962 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:48.963+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:48.980 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:48.982+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:49.957 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:49.958+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:50.011 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:50.012+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:50.928 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:50.930+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:50.994 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:50.996+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:51.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:51.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:52.036 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:52.038+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:52.949 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:52.950+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:53.083 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:53.084+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:53.994 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:53.996+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:54.119 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:54.121+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:54.978 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:54.980+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:55.094 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:55.095+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:56.012 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:56.014+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:56.115 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:56.116+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:57.006 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:57.008+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:57.156 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:57.157+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:58.026 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:58.028+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:58.116 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:58.117+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:59.072 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:09:59.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:09:59.141 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:09:59.142+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:00.053 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:00.052+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:00.158 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:00.159+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:01.050 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:01.051+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:01.163 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:01.164+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:02.021 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:02.021+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:02.208 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:02.209+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:03.071 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:03.072+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:03.200 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:03.200+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:04.034 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:04.034+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:04.207 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:04.207+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:04.988 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:04.989+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:05.251 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:05.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:05.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:05.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:06.264 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:06.265+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:07.029 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:07.029+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:07.282 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:07.282+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:08.036 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:08.037+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:08.266 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:08.267+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:08.990 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:08.991+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:09.263 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:09.264+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:09.998 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:09.999+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:10.269 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:10.269+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:10.967 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:10.967+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:11.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:11.256+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:11.993 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:11.994+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:12.283 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:12.284+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:13.005 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:13.005+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:13.289 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:13.290+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:14.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:14.055+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:14.255 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:14.255+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:15.060 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:15.060+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:15.272 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:15.273+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:16.074 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:16.074+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:16.238 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:16.238+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:17.055 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:17.056+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:17.278 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:17.279+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:18.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:18.011+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:18.252 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:18.252+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:19.010 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:19.010+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:19.234 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:19.234+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:19.986 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:19.987+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:20.271 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:20.272+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:20.941 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:20.941+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:21.260 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:21.261+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:21.911 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:21.912+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:22.281 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:22.281+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:22.954 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:22.954+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:23.254 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:23.254+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:23.921 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-23T03:10:23.921+0000 7f7f2b1ce700 -1 osd.1 25 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.4222.0:8156 3.0 3:391bc192:::rbd_data.107b81200e13.0000000000000032:head [set-alloc-hint object_size 4194304 write_size 4194304,write 454656~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:24.280 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-23T03:10:24.280+0000 7fefbb447700 -1 osd.2 25 get_health_metrics reporting 153 slow ops, oldest is osd_op(osd.1.8:1889 2.0 2:1e4a20e3:::rbd_data.107b81200e13.0000000000000052:head [copy-from ver 1475 in=76b] snapc 0=[] ondisk+write+ignore_overlay+enforce_snapc+known_if_redirected+supports_pool_eio e24) 2023-07-23T03:10:24.871 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-23T03:10:24.879 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2023-07-23T03:10:24.897 DEBUG:teuthology.exit:Finished running handlers